-- Logs begin at Tue 2022-10-04 08:04:08 UTC, end at Tue 2022-10-04 09:12:46 UTC. -- Oct 04 08:37:10.499542 dv-cinder-860212-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 08:37:10.507823 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:37:10 2022] *** Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: nodename: dv-cinder-860212-1-iscsi Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: machine: x86_64 Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: clock source: unix Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: pcre jit disabled Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: detected number of CPU cores: 4 Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: current working directory: / Oct 04 08:37:10.510291 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:37:10.510915 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: your processes number limit is 47680 Oct 04 08:37:10.510915 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: your memory page size is 4096 bytes Oct 04 08:37:10.510915 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: detected max file descriptor number: 2048 Oct 04 08:37:10.510915 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: lock engine: pthread robust mutexes Oct 04 08:37:10.510915 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: thunder lock: enabled Oct 04 08:37:10.510915 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 08:37:10.510915 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:37:10.549109 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: Python main interpreter initialized at 0x561b535319c0 Oct 04 08:37:10.549109 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: python threads support enabled Oct 04 08:37:10.549109 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: your server socket listen backlog is limited to 100 connections Oct 04 08:37:10.549109 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:37:10.549439 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:37:10.549529 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: *** Operational MODE: preforking *** Oct 04 08:37:10.549785 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:37:10.549785 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: spawned uWSGI master process (pid: 111922) Oct 04 08:37:10.549968 dv-cinder-860212-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 08:37:10.551825 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: spawned uWSGI worker 1 (pid: 111923, cores: 1) Oct 04 08:37:10.551825 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: spawned uWSGI worker 2 (pid: 111924, cores: 1) Oct 04 08:37:10.551825 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:37:11.200799 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:37:11.201805 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:37:12.276993 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:37:12.276993 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: from cryptography.utils import int_from_bytes Oct 04 08:37:12.277639 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:37:12.277639 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: from cryptography.utils import int_from_bytes Oct 04 08:37:12.280309 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:37:12.280309 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: from cryptography.utils import int_from_bytes Oct 04 08:37:12.280751 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:37:12.280751 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: from cryptography.utils import int_from_bytes Oct 04 08:37:14.754842 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:37:14.755391 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:37:14.755610 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:37:14.755719 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:37:14.756075 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:37:14.756166 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:37:14.756258 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:37:14.756442 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:37:14.756578 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.756807 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:37:14.756908 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.757068 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:37:14.757199 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.757458 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.757562 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.757815 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.757918 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.758170 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.758264 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.758486 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.758580 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.758803 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.758897 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.759113 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.759215 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.759367 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.759461 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.759680 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.759785 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.760000 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-1-iscsi {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.760172 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.760302 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.760395 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.760606 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.760698 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.760910 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.761004 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-1-iscsi {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.761221 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.761313 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.761542 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.761678 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.761871 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.761975 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.762163 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.762266 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.762472 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.762648 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.762833 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.763785 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.763893 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.763963 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764029 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764120 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764194 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764265 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764339 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764419 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764503 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764574 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764835 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.764925 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.765078 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.765172 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.765388 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.765486 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.765725 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.765817 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.766033 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.766134 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-1-iscsi {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.766357 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.766460 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.766667 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.766838 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.767020 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.767116 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-1-iscsi {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.767370 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.767518 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.767679 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.767766 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.767989 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.768089 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.768300 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.768389 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.768619 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.768716 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.768922 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.769025 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.769243 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.769332 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.769558 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.769658 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.769897 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.770006 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.770210 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.770308 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.770508 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.770606 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.770809 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.770908 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.771113 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.771212 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.771425 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.771543 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.771724 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.771815 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.772022 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.772121 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.772260 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.772346 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.772560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.772706 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.772877 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.773028 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.773171 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.773314 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.773462 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.774144 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.774317 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.774455 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.774589 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.774740 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.774882 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.775023 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.775160 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.775305 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.775442 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.775586 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.775730 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.775863 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776004 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776144 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776292 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776427 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776570 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776711 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776852 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.776993 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.777140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.777282 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.777429 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.777583 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.777780 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.777933 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.778077 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.778211 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.778345 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.778477 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.778610 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.778743 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.778890 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.779035 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.779261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.779412 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.779548 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.779691 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.779832 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.779965 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.780109 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.780244 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.780404 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.780558 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.780705 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.780846 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.781003 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.781159 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.781315 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.781459 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.781592 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.781778 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.781919 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.782060 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.782194 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.782336 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.782480 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.782626 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.782809 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.782957 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.783105 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.783251 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.783392 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.783532 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.783679 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.783827 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.783978 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.784114 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.784248 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.784381 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.784520 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.784663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.784810 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.784963 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.785109 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.785250 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.785384 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.785529 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.785672 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.785858 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.785993 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.786126 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.786268 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.786415 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.786550 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.786690 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.786848 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.786990 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.787130 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.787273 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.787407 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.787540 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.787674 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.787846 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.787990 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.788136 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.788277 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.788418 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.788564 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.788715 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.788857 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.789000 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.789143 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.789364 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.790079 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.790229 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.790366 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.790514 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.790657 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.790797 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.790932 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.791072 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.791233 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.791445 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.791581 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.791723 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.791857 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.791998 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.792133 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.792276 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.792417 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.792552 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.792686 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.792854 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.793003 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.793162 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.793299 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.793442 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.793613 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.793792 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.793946 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.794083 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.794217 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.794352 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.794486 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.794662 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.794817 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.794953 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.795097 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.795260 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.795404 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.795574 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.795729 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.795865 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.795999 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.796143 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.796285 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.796427 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.796573 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.796708 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.796852 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.796987 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.797126 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.797295 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.797451 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.797610 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.797809 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.797949 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.798081 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.798224 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.798359 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.798494 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.798628 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.798804 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.798955 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.799122 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.799271 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.799407 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.799542 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.799716 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.799866 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.800033 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:37:14.800184 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.800367 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.800510 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.800693 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.800852 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.800989 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.801123 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.801300 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.801441 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.801610 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.801791 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.801939 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.802073 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.802247 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.802389 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.802554 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.802721 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.802857 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.802991 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.803158 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.803300 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.803471 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.803614 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.803799 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.803971 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.804131 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.804267 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.804402 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.804545 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.804691 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.804825 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.805026 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.805170 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.805343 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.805495 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.805641 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.805819 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.805987 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.806130 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.806277 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.806413 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.806605 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.806756 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.806936 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.807079 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.807228 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.807362 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.807549 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.807700 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.807866 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.808010 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.808177 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.808320 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.808484 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.808637 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.808773 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.808907 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.809109 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.809253 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.809418 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.809567 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.809750 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.809906 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.810055 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.810189 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.810324 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.810456 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.810643 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.810799 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.810936 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.811079 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.811244 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.811395 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.811540 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.811688 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.811831 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.811966 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.812134 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.812277 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.812464 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.812629 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.812772 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.812906 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.813071 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.813214 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.813379 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.813599 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.813805 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.813946 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.814081 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.814225 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.814369 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.814521 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.814667 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.814809 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.814945 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.815095 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.815238 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.815374 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.815508 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.815652 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.815787 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.815920 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.816066 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.816213 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.816359 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.816493 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.816627 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.817057 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.817218 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.817364 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.817500 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.817642 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.817817 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.817969 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.818106 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.818240 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.818375 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.818521 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.818655 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.818802 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.818937 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.819078 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.819213 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.819346 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.819481 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.819628 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.819770 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.819911 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.820046 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.820180 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.820323 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.820467 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.820603 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.820737 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.821369 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.821515 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.821660 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.821824 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.821960 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.822105 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.822247 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.822381 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.822529 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.822682 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.822818 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.822988 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.823132 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.823296 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.823449 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.823607 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.823757 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.823923 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.824073 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.824235 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.824388 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.824544 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.824680 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.824841 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.824984 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.825153 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.825296 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.825476 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.825620 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.825817 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.825966 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.826120 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.826263 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.826429 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.826582 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.826718 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.826859 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.827002 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.827137 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.827303 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.827456 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.827601 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.827735 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.827879 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.828014 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.828175 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.828318 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.828470 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.828614 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.828749 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.828890 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.829041 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.829183 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.829317 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.829476 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.829626 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.829805 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.829951 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.830086 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.830219 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.830377 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.830520 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.830662 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.830804 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.830947 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.831083 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.831225 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.831387 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.831530 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.831672 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.831808 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.832008 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.832163 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.832339 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.832482 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.832652 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.832793 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.832970 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.833112 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.833276 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.833418 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.833587 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.833763 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.833918 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.834055 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.834208 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.834343 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.834487 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.834627 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.834774 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.834909 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.835094 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.835245 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.835387 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.835531 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.835712 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.835860 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.836020 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.836754 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.836910 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.837056 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.837200 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.837344 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.837479 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.837614 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.837810 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.837973 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.838111 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.838253 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.838444 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.838586 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.838756 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.838909 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.839070 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.839210 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.839375 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.839524 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.839681 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.839835 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.839993 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.840135 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.840297 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.840440 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.840605 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.840758 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.840893 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.841027 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.841200 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.841341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.841513 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.841656 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.841920 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.842071 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.842214 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.842348 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.842559 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.842708 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.842843 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.842984 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.843126 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.843262 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.843405 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.843540 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.843675 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.843809 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.843953 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.844096 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.844239 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.844374 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.844524 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.844661 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.844819 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.844976 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.845112 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.845253 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.845428 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.845571 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.845744 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.845904 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.846041 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.846177 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.846349 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.846504 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.846640 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.846785 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.846921 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.847055 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.847226 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.847368 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.847539 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.847683 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.847820 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.847954 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.848117 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.848260 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.848679 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.848817 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.848981 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.849124 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.849285 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.849428 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.849571 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.849765 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.849909 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.850044 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.850177 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.850310 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.850487 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.850642 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.850778 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.850913 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.851096 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.851239 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.851382 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.851517 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.851690 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.851833 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.852013 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.852164 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.852317 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.852469 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.852610 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.852750 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.852890 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.853061 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.853250 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.853402 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.853544 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.853707 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.853869 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.854022 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.854165 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.854312 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.854463 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.854611 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.854752 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.854905 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.855052 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.855198 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.855338 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.855478 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.855627 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.855796 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.855962 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.856106 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.856255 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.856407 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.856557 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.856699 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.856838 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.856978 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.857126 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.857269 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.857418 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.857560 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.857733 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.857898 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.858048 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.858190 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.858351 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.858500 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.858641 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.858781 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.858920 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.859069 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.859217 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.859360 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.859500 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.859640 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.859780 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.859930 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.860082 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.860229 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.860379 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.860520 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.860756 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.860917 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.861061 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.861209 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.861356 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.861499 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.861639 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.861829 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.861981 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.862136 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.862380 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.862553 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.862698 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.862845 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.863021 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.863178 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.863321 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.863461 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.863625 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.863783 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.863936 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.864091 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.864244 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.864427 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.864589 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.864758 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.864906 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.865065 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.865214 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.865359 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.865500 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.865666 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.865962 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.866109 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.866256 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.866410 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.866551 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.866692 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.866842 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.866992 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.867134 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.867283 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.867426 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.867567 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.867717 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.867859 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.868000 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.868156 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.868305 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.868446 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.868596 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.868740 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.868880 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.869021 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.869162 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.869312 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.869453 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.869603 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.869765 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.869915 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.870067 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.870220 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.870363 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.870536 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.870691 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.870836 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.870977 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.871162 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.871314 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.871455 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.871597 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.871737 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.871878 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.872038 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.872189 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.872331 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.872472 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.872621 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.872775 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.872919 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.873060 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.873201 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.873341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.873482 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.873636 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.873844 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.873998 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.874141 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.874282 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.874422 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.874572 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.874713 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.874854 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.874994 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.875142 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.875306 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.875449 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.875590 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.875742 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.875884 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.876025 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.876176 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.876325 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.876467 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.876615 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.876757 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.876905 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.877055 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.877204 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.877346 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.877487 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.877645 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.877801 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.877924 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.878015 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.878106 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.878315 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.878408 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.878626 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.878728 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.878935 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.879025 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.879234 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.879322 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.879537 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.879635 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.879839 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.879935 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.880142 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.880231 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.880445 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.880533 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.880746 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.880840 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.881062 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.881147 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.881368 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.881456 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.881666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.881768 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.881986 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.882074 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.882293 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.882403 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.882594 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.882681 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.882896 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.883568 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.883743 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.883911 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.884061 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.884209 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.884358 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.884510 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.884652 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.884793 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.884934 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.885100 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.885245 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.885400 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.885544 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.885708 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.885874 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.886016 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.886156 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.886309 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.886451 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.886593 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.886733 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.886873 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.887027 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.887169 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.887310 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.887450 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.887591 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.887742 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.887891 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.888033 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.888174 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.888314 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.888461 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.888613 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.888764 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.888914 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.889055 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.889203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.889345 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.889486 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.889645 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.889826 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.889980 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.890129 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.890270 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.890420 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.890568 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.890717 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.890869 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.891010 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.891150 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.891299 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.891448 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.891599 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.891739 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.891880 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.892028 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.892187 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.892328 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.892511 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.892659 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.892808 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.892957 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.893107 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.893249 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.893400 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.893541 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.893774 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.894005 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.894150 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.894291 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.894432 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.894582 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.894732 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.894887 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.895030 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.895178 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.895327 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.895487 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.895637 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.895787 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.895929 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.896071 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.896212 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.896352 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.896492 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.896641 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.896811 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.896960 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.897109 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.897250 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.897427 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.897570 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.897740 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.897888 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.898041 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.898183 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.898337 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.898497 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.898497 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.898842 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.898986 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.899129 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.899279 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.899444 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.899586 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.899728 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.899869 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.900009 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.900158 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.900301 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.900442 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.900583 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.900724 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.900878 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.901021 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.901171 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.901314 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.901454 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.901595 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.901779 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.901928 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.902077 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.902219 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.902361 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.902502 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.902690 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.902845 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.902987 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.903139 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.903287 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.903430 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.903580 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.903730 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.903913 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.904061 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.904210 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.904361 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.904503 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.904644 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.904784 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.904926 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.905078 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.905228 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.905370 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.905512 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.905653 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.905833 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.905986 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.906141 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.906283 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.906423 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.906565 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.906705 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.906852 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.907011 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.907161 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.907302 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.907443 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.907584 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.907731 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.907881 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.908024 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.908165 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.908305 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.908453 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.908607 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.908761 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.908902 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.909055 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.909204 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.909345 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.909495 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.909638 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.909805 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.910023 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.910199 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.910351 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.910501 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.910643 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.910798 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.910939 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.911080 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.911228 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.911376 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.911518 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.911658 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.911822 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.911999 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.912152 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.912294 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.912441 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.912644 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.912844 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.912987 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.913128 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.913290 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.913396 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.913569 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.913659 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.913919 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.914009 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.914767 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.914939 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.915085 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.915244 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.915387 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.915529 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.915694 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.915852 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.915997 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.916138 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.916327 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.916484 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.916635 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.916777 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.916941 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.917091 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.917244 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.917394 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.917549 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.917739 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.917889 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.918032 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.918197 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.918346 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.918504 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.918647 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.918789 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.918931 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.919074 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.919226 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.919381 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.919531 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.919673 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.919821 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.919966 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.920144 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.920294 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.920443 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.920592 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.920742 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.920884 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.921042 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.921203 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.921346 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.921486 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.921636 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.921816 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.921976 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.922126 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.922268 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.922410 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.922558 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.922710 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.922906 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.923068 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.923212 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.923354 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.923496 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.923651 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.923793 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.923942 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.924084 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.924226 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.924367 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.924517 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.924668 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.924810 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.924969 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.925111 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.925252 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.925403 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.925544 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.925736 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.925887 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.926030 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.926172 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.926325 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.926469 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.926610 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.926751 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.926902 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.927052 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.927193 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.927334 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.927487 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.927663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.927813 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.927963 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.928112 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.928276 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.928426 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.928608 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.928758 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.928922 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.929064 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.929207 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.929347 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.929489 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.929630 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.929825 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.930020 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.930175 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.930317 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.930467 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.930619 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.930773 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.930913 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.931062 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.931204 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.931345 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.931495 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.931647 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.931789 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.931931 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.932072 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.932214 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.932399 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.932543 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.932695 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.932844 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.933027 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.933181 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.933332 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.933475 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.933624 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.933807 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.933950 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.934109 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.934259 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.934401 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.934548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.934701 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.934844 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.934993 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.935135 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.935276 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.935424 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.935572 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.935713 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.935863 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.936006 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.936146 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.936286 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.936436 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.936577 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.936731 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.936873 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.937015 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.937162 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.937303 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.937452 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.937595 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.937756 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.937906 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.938048 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.938364 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.938542 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.938692 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.938842 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.938986 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.939127 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.939269 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.939486 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.939630 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.939778 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.939920 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.940079 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.940222 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.940376 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.940535 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.940677 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.940818 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.940958 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.941112 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.941262 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.941411 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.941587 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.941784 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.941934 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.942085 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.942252 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.942406 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.942555 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.942697 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.942903 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.943103 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.943251 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.943393 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.943534 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.943675 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.943825 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.943967 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.944109 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.944269 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.944415 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.944557 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.944706 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.944849 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.944990 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.945131 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.945280 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.945432 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.946175 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.946261 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.946451 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.946539 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.946765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.946928 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.947079 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.947173 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.947390 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.947478 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.947701 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.947797 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.948007 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.948102 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.948318 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.948406 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.948628 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.948725 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.948950 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.949037 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.949264 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.949351 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.949580 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.949668 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.949911 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.949997 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.950221 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.950318 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.950535 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.950623 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.950851 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.951045 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.951164 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.951357 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.951474 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.951685 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.951773 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.952008 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.952096 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.952332 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.952424 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.952643 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.952730 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.952957 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.953051 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.953280 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.953422 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.953584 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.953746 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.953911 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.954054 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.954218 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.954466 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.954600 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.954785 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.954911 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.955117 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.955236 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.955521 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.955645 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.955756 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.955878 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.956008 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.956132 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.956312 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.956438 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.956674 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.956848 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.956983 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.957192 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.957324 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.957509 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.957635 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.957858 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.957994 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.958185 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.958310 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.958500 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.958626 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.958807 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.958935 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.959110 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.959234 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.959421 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.959545 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.959726 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.959864 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.960042 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.960258 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.960392 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.960606 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.960740 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.960926 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.961051 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.961360 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.961485 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.961648 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.961795 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.961978 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.962116 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.962290 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.962417 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.962594 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.962723 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.962919 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.963046 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.963225 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.963355 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.963531 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.963660 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.963835 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.963969 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.964143 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.964269 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.964445 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.964570 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.964749 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.964885 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.965053 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.965188 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.965355 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.965482 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.965664 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.965896 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.966018 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.966151 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.966283 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.966407 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.966567 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.966693 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.966881 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.967022 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.967190 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.967317 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.967505 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.967632 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.967805 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.967942 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.968112 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.968238 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.968416 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.968541 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.968721 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.968855 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.969031 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.969155 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.969335 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.969462 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.969648 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.969804 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.969979 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.970105 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.970289 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.970413 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.970628 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.970763 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.970941 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.971069 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.971240 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.971467 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.971605 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.971801 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.971927 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.972117 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.972243 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.972448 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.972575 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.972758 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.972882 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.973068 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.973192 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.973623 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.973789 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.973955 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.974090 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.974273 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.974408 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.974581 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.974710 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.974890 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.975137 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.975272 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.975477 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.975614 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.975779 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.975904 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.976085 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.976219 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.976419 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.976545 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.976688 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.977329 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.977521 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.977647 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.977852 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.977990 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.978158 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.978285 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.978465 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.978592 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.978770 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.978900 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.979076 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.979202 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.979387 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.979526 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.979699 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.979825 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.980011 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.980138 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.980321 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.980456 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.980628 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.980760 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.980934 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.981062 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.981239 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.981372 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.981546 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.981673 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.981881 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.982009 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.982188 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.982314 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.982496 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.982620 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.982805 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.982930 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.983117 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.983243 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.983420 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.983547 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.983764 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.984074 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.984212 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.984389 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.984516 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.984699 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.984824 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.985011 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.985139 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.985319 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.985444 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.985627 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.985770 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.985971 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.986099 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.986279 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.986403 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.986601 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.986735 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.986905 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.987032 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.987228 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.987563 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.987689 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.987879 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.988020 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.988199 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.988326 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.988502 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.988628 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.988805 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.988939 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.989106 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.989234 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.989411 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.989537 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.989747 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.989878 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.990056 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.990182 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.990359 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.990485 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.990660 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.990789 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.990966 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.991092 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.991267 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.991403 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.991566 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.991694 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.991866 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.991993 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.992166 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.992305 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.992547 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.992677 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.992851 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.992986 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.993152 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.993292 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.993454 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.993582 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.993834 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.993964 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.994099 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.994223 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.994345 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.994466 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.994642 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.994769 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.994943 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.995079 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.995244 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.995379 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.995545 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.995673 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.995848 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.995976 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.996149 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.996268 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.996455 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.996582 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.996761 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.996889 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.997068 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.997194 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.997373 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.997500 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.997678 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.997844 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.998012 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.998138 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.998316 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.998452 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.998618 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.998744 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.998923 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.999049 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.999227 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.999361 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.999529 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.999653 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.999858 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:14.999984 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.000165 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.000304 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.000471 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.000605 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.000779 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.000914 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.001087 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.001215 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.001394 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.001520 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.001713 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.001842 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.002043 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.002171 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.002365 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.002490 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.002667 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.002792 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.002976 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.003111 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.003289 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.003422 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.003604 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.003731 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.003901 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.004027 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.004213 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.004341 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.004526 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.004662 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.004831 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.004957 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.005138 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.005264 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.005445 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.005645 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.005792 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.005915 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.006077 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.006217 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.006388 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.006525 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.006700 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.006828 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.007005 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.007133 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.007315 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.007444 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.007626 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.007751 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.007946 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.008595 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.008794 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.008928 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.009101 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.009226 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.009409 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.009542 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.009741 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.009873 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.010058 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.010184 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.010376 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.010517 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.010689 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.010823 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.011001 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.011127 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.011320 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.011460 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.011627 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.011752 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.011931 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.012058 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.012180 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:37:15.012315 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.012565 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.012905 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.013232 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.013581 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.013955 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.014271 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.014606 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.014924 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.015241 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.015549 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:37:15.015797 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:37:15.164232 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO dbcounter [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Registered counter for database nova_api Oct 04 08:37:15.167452 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO dbcounter [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Registered counter for database nova_api Oct 04 08:37:15.186149 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_db.sqlalchemy.engines [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.187902 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.192783 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writer thread running {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.194363 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writer thread running {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.249375 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.context [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cae228f-af20-4704-b46a-066502ec8d5b(cell1) {{(pid=111924) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:37:15.251085 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.context [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cae228f-af20-4704-b46a-066502ec8d5b(cell1) {{(pid=111923) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:37:15.253208 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:37:15.253673 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:37:15.254917 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_concurrency.lockutils [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:37:15.255219 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:37:15.255387 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_concurrency.lockutils [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:37:15.255938 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:37:15.256377 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:37:15.256934 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_concurrency.lockutils [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:37:15.257651 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_concurrency.lockutils [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:37:15.258750 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_concurrency.lockutils [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:37:15.258918 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:37:15.260730 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_concurrency.lockutils [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:37:15.260876 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO dbcounter [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Registered counter for database nova_cell0 Oct 04 08:37:15.262733 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO dbcounter [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Registered counter for database nova_cell0 Oct 04 08:37:15.264846 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO dbcounter [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Registered counter for database nova_cell1 Oct 04 08:37:15.266902 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO dbcounter [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Registered counter for database nova_cell1 Oct 04 08:37:15.271987 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_db.sqlalchemy.engines [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.273759 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_db.sqlalchemy.engines [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.275483 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.277244 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.279881 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writer thread running {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.282160 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writer thread running {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.282293 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writer thread running {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.418892 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writer thread running {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.425852 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO dbcounter [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Registered counter for database nova_cell0 Oct 04 08:37:15.428602 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO dbcounter [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Registered counter for database nova_cell0 Oct 04 08:37:15.435555 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_db.sqlalchemy.engines [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.438810 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:37:15.440016 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writer thread running {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.443449 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writer thread running {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:37:15.779371 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: WARNING keystonemiddleware.auth_token [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:37:15.779985 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: WARNING keystonemiddleware.auth_token [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:37:15.786715 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: WARNING keystonemiddleware.auth_token [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:37:15.786854 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: WARNING keystonemiddleware.auth_token [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:37:16.127175 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: WARNING keystonemiddleware.auth_token [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:37:16.127369 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: WARNING keystonemiddleware.auth_token [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:37:16.133126 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: WARNING keystonemiddleware.auth_token [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:37:16.133234 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: WARNING keystonemiddleware.auth_token [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:37:16.138383 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b535319c0 pid: 111923 (default app) Oct 04 08:37:16.139477 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b535319c0 pid: 111924 (default app) Oct 04 08:37:16.140440 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:37:16.141616 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-e7ef0285-80fe-4e3c-8d1b-9042c4fa512d None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Oct 04 08:37:16.142047 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Tue Oct 4 08:37:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:37.597375 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:37.598625 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002789 Oct 04 08:38:37.600139 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:38:37 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:37.610118 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_api:SELECT=3 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:37.611249 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_cell1:SELECT=3 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:37.613916 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_cell0:SELECT=3 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:37.614798 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:38.571644 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-e2e0ab3c-a6b5-4050-a6b9-83db22356297 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:38.606717 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-e2e0ab3c-a6b5-4050-a6b9-83db22356297 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.001573 Oct 04 08:38:38.607758 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 08:38:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:38:41.240743 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:41.242210 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-2708629d-cd94-4188-ae2e-18c2ad0f847b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001814 Oct 04 08:38:41.242882 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:38:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:41.690784 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-9f19d14d-02ae-434f-bda1-2f8591841948 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "swap": 0, "vcpus": 1, "ram": 256}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:41.737825 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-9f19d14d-02ae-434f-bda1-2f8591841948 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488580 Oct 04 08:38:41.738385 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:38:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:38:41.751729 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_api:SELECT=3 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:41.752566 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_cell0:SELECT=3 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:41.754468 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_cell1:SELECT=3 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:41.755488 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:41.985674 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-c45dc949-a3c8-4754-9443-a108e1bfbc30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:42.056907 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-c45dc949-a3c8-4754-9443-a108e1bfbc30 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.310211 Oct 04 08:38:42.057898 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 08:38:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:38:44.681361 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-9f19d14d-02ae-434f-bda1-2f8591841948 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:44.682413 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-9f19d14d-02ae-434f-bda1-2f8591841948 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 04 08:38:44.682815 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:38:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:45.347214 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-b7878524-32b2-4d47-9766-5b9c3ac1feac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:45.390847 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-b7878524-32b2-4d47-9766-5b9c3ac1feac admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700705 Oct 04 08:38:45.393345 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:38:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:38:45.407346 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-3c7a44e0-e43c-4bc6-8250-79d2b44de8ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:45.462956 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-3c7a44e0-e43c-4bc6-8250-79d2b44de8ec admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059432 Oct 04 08:38:45.469755 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 08:38:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:38:48.276483 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-b7878524-32b2-4d47-9766-5b9c3ac1feac admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:48.277502 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-b7878524-32b2-4d47-9766-5b9c3ac1feac admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Oct 04 08:38:48.277962 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:38:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:48.709391 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-a687e35b-29e1-4a6c-83d4-9a83df01ee71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:48.729658 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-a687e35b-29e1-4a6c-83d4-9a83df01ee71 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445376 Oct 04 08:38:48.730478 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:38:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:38:48.742624 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-acf2eeaa-af03-497c-8dd3-861b6d1eecfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:48.771955 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-acf2eeaa-af03-497c-8dd3-861b6d1eecfa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033175 Oct 04 08:38:48.772580 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 08:38:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:38:51.428038 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-a687e35b-29e1-4a6c-83d4-9a83df01ee71 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:51.429438 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-a687e35b-29e1-4a6c-83d4-9a83df01ee71 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Oct 04 08:38:51.429981 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:51.875304 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-c9805ffe-db6b-4286-a191-54ec0c5d56d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:51.897783 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-c9805ffe-db6b-4286-a191-54ec0c5d56d0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461473 Oct 04 08:38:51.901078 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:38:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:38:51.912005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-792d949e-426b-437e-b595-4ccc6557e341 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:51.941451 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-792d949e-426b-437e-b595-4ccc6557e341 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034138 Oct 04 08:38:51.945431 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 08:38:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:38:54.637851 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-c9805ffe-db6b-4286-a191-54ec0c5d56d0 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:54.638863 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-c9805ffe-db6b-4286-a191-54ec0c5d56d0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Oct 04 08:38:54.639273 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:55.075165 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-e0220767-1cef-442e-8fb9-3362992e0acc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:55.095375 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-e0220767-1cef-442e-8fb9-3362992e0acc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449721 Oct 04 08:38:55.095939 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:38:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:38:55.108281 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-9799dc35-2f0b-42b8-b45b-fa645e2ab595 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:38:55.134598 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-9799dc35-2f0b-42b8-b45b-fa645e2ab595 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030267 Oct 04 08:38:55.135204 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 08:38:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:38:57.750648 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-e0220767-1cef-442e-8fb9-3362992e0acc admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:57.751706 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-e0220767-1cef-442e-8fb9-3362992e0acc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 04 08:38:57.752130 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:38:58.171509 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-dff200b8-b45c-4d98-9a5d-62275590de0a admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:38:58.204121 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-dff200b8-b45c-4d98-9a5d-62275590de0a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445727 Oct 04 08:38:58.204928 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 08:38:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:00.900594 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-e0220767-1cef-442e-8fb9-3362992e0acc admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:00.901598 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-e0220767-1cef-442e-8fb9-3362992e0acc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 04 08:39:00.902044 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:01.293294 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-ed236473-5534-4cb8-bacd-41655dc7a6ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "disk": 1}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:01.315355 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-ed236473-5534-4cb8-bacd-41655dc7a6ea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.407383 Oct 04 08:39:01.315894 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:39:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:39:01.327634 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-8993b8a4-d40c-41ee-8c23-86404e298b97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:01.355543 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-8993b8a4-d40c-41ee-8c23-86404e298b97 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031334 Oct 04 08:39:01.356072 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 08:39:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:39:03.926333 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-ed236473-5534-4cb8-bacd-41655dc7a6ea admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:03.927426 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-ed236473-5534-4cb8-bacd-41655dc7a6ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 04 08:39:03.927910 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:04.311329 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-39262098-4830-43c9-9f6f-d191cf6f0794 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:04.331290 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-39262098-4830-43c9-9f6f-d191cf6f0794 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.397348 Oct 04 08:39:04.332013 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:39:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:39:04.344054 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-36aa7489-5511-4d44-9e26-f962ea678499 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:04.367306 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-36aa7489-5511-4d44-9e26-f962ea678499 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026796 Oct 04 08:39:04.367872 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 08:39:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:39:07.097369 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-39262098-4830-43c9-9f6f-d191cf6f0794 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:07.098437 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-39262098-4830-43c9-9f6f-d191cf6f0794 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 04 08:39:07.102012 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:39:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:07.586877 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-85fcd01b-d9f1-4c8a-ac51-a1d7346002c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "swap": 0}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:07.609609 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-85fcd01b-d9f1-4c8a-ac51-a1d7346002c0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.503948 Oct 04 08:39:07.610815 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:39:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:39:07.622805 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-4ccb9446-04b0-4ce6-a442-cce61e59c73f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:07.655301 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:07.658087 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-4ccb9446-04b0-4ce6-a442-cce61e59c73f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038758 Oct 04 08:39:07.673727 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 08:39:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:39:10.296590 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-85fcd01b-d9f1-4c8a-ac51-a1d7346002c0 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:10.297637 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-85fcd01b-d9f1-4c8a-ac51-a1d7346002c0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 04 08:39:10.298118 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:10.729669 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-7592b3d6-3795-465e-a2ed-acfb1e33d581 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "disk": 80}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:10.749811 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-7592b3d6-3795-465e-a2ed-acfb1e33d581 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445616 Oct 04 08:39:10.750353 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:39:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:39:10.762817 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-a7f98e87-57e1-4a21-b964-2a4a7457993a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:10.786862 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-a7f98e87-57e1-4a21-b964-2a4a7457993a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027651 Oct 04 08:39:10.801716 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 08:39:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:39:13.428804 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-7592b3d6-3795-465e-a2ed-acfb1e33d581 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:13.429872 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-7592b3d6-3795-465e-a2ed-acfb1e33d581 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 04 08:39:13.430439 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:13.870858 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-bca5344b-26d7-4bcb-a499-f7ee1885442b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge"}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:13.880134 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:13.892191 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-bca5344b-26d7-4bcb-a499-f7ee1885442b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455695 Oct 04 08:39:13.893056 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 08:39:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:39:13.904716 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-2b8681db-c721-400e-a26c-f366fd691de7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:13.930334 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-2b8681db-c721-400e-a26c-f366fd691de7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028949 Oct 04 08:39:13.930741 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 08:39:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:39:30.392293 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-bca5344b-26d7-4bcb-a499-f7ee1885442b admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:30.393321 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-bca5344b-26d7-4bcb-a499-f7ee1885442b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 04 08:39:30.393755 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:30.404207 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=2,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:30.781803 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-d835bb51-1aa1-47ba-abef-42c1c8891fa7 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:30.800054 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-d835bb51-1aa1-47ba-abef-42c1c8891fa7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400281 Oct 04 08:39:30.800586 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 08:39:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:32.103512 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-bca5344b-26d7-4bcb-a499-f7ee1885442b admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:32.104515 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-bca5344b-26d7-4bcb-a499-f7ee1885442b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 04 08:39:32.104913 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:32.620955 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-daf99051-30d4-4c87-a199-ca1e2c925790 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:32.626376 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.wsgi [None req-daf99051-30d4-4c87-a199-ca1e2c925790 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-daf99051-30d4-4c87-a199-ca1e2c925790 admin admin] Request method failure captured: Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Accept: application/json Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Accept-Encoding: gzip, deflate Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Connection: keep-alive Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Content-Length: 0 Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Host: 10.222.0.26 Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Openstack-Api-Version: compute 2.92 Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Openstack-System-Scope: None Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: User-Agent: python-novaclient Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Auth-Token: gAAAAABjO_FElZFEbJUa9R7I6UAnoIyVN4s4Cz5Y66sVMQfkUePTyRO0x2zzty5CiLDQoVQMZsNsItF599NYQXsGte9IiNJsYaOpBkz87vi7ckZ4a3fn9BdfUMianrxcJL3ilISLtcx5y-GMKgWtlj1ckKmOvuCcBGrbGqZs1cdDPpYG9YEhdbI Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Domain-Id: None Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Domain-Name: None Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Identity-Status: Confirmed Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Is-Admin-Project: True Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Domain-Id: default Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Domain-Name: Default Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Name: admin Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Role: reader,admin,member Oct 04 08:39:32.629548 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Roles: reader,admin,member Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}] Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant: admin Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant-Name: admin Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User: admin Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Domain-Id: default Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Domain-Name: Default Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Id: f84b5144054d4e158a838b4ae551996f Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Name: admin Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: method: > Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: exception: Flavor 42 could not be found. Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: action_args: {'id': '42'} Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:39:32.631281 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:32.632203 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.633341 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-daf99051-30d4-4c87-a199-ca1e2c925790 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:39:32.634455 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-daf99051-30d4-4c87-a199-ca1e2c925790 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389086 Oct 04 08:39:32.634455 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 08:39:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:32.641851 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-023d5633-6b91-414b-aae5-4ab4a6bc5393 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:32.664972 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-023d5633-6b91-414b-aae5-4ab4a6bc5393 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027745 Oct 04 08:39:32.665537 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 08:39:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:32.676210 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-9d334f0f-1e54-48e7-bf09-ed30f85c1a93 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:32.697889 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-9d334f0f-1e54-48e7-bf09-ed30f85c1a93 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026198 Oct 04 08:39:32.698417 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 08:39:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:32.708277 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-b78a2e06-8141-4edb-b1e9-7cbbcd704db4 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:32.713494 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.wsgi [None req-b78a2e06-8141-4edb-b1e9-7cbbcd704db4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-b78a2e06-8141-4edb-b1e9-7cbbcd704db4 admin admin] Request method failure captured: Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Accept: application/json Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Accept-Encoding: gzip, deflate Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Connection: keep-alive Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Content-Length: 0 Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Host: 10.222.0.26 Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Openstack-Api-Version: compute 2.92 Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Openstack-System-Scope: None Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: User-Agent: python-novaclient Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Auth-Token: gAAAAABjO_FElZFEbJUa9R7I6UAnoIyVN4s4Cz5Y66sVMQfkUePTyRO0x2zzty5CiLDQoVQMZsNsItF599NYQXsGte9IiNJsYaOpBkz87vi7ckZ4a3fn9BdfUMianrxcJL3ilISLtcx5y-GMKgWtlj1ckKmOvuCcBGrbGqZs1cdDPpYG9YEhdbI Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Domain-Id: None Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Domain-Name: None Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Identity-Status: Confirmed Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Is-Admin-Project: True Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Domain-Id: default Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Domain-Name: Default Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Name: admin Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Role: reader,admin,member Oct 04 08:39:32.716765 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Roles: reader,admin,member Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}] Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant: admin Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant-Name: admin Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User: admin Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Domain-Id: default Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Domain-Name: Default Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Id: f84b5144054d4e158a838b4ae551996f Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Name: admin Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: method: > Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: exception: Flavor 42 could not be found. Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: action_args: {'id': '42'} Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:39:32.718322 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:32.720140 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:32.721593 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-b78a2e06-8141-4edb-b1e9-7cbbcd704db4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:39:32.722906 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-b78a2e06-8141-4edb-b1e9-7cbbcd704db4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013584 Oct 04 08:39:32.722906 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 08:39:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 08:39:33.939533 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-9d334f0f-1e54-48e7-bf09-ed30f85c1a93 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:33.940557 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-9d334f0f-1e54-48e7-bf09-ed30f85c1a93 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 04 08:39:33.940995 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:34.460143 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-6f231841-4594-429b-99f3-d273754d7752 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:34.465148 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.wsgi [None req-6f231841-4594-429b-99f3-d273754d7752 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-6f231841-4594-429b-99f3-d273754d7752 admin admin] Request method failure captured: Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Accept: application/json Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Accept-Encoding: gzip, deflate Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Connection: keep-alive Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Content-Length: 0 Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Host: 10.222.0.26 Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Openstack-Api-Version: compute 2.92 Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Openstack-System-Scope: None Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: User-Agent: python-novaclient Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Auth-Token: gAAAAABjO_FFestdR0magM9SphpYfuqPjyx7cGf_KW57jmpwPBT3sKqyQfaSt4qvnps-wEDQ9JTaJsugiXjnoaHW_vLo2IdA0sM9kG5Qn34lXe8msDa2fGm-Z1Z1N8VSGsEcC13RtHDNcAZx4JDAajxE0xYeu5OOJ2S5-g5gwyRfFZU8lqryZm4 Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Domain-Id: None Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Domain-Name: None Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Identity-Status: Confirmed Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Is-Admin-Project: True Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Domain-Id: default Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Domain-Name: Default Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Name: admin Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Role: reader,admin,member Oct 04 08:39:34.466666 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Roles: reader,admin,member Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}] Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant: admin Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant-Name: admin Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User: admin Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Domain-Id: default Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Domain-Name: Default Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Id: f84b5144054d4e158a838b4ae551996f Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Name: admin Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: method: > Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: exception: Flavor 84 could not be found. Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: action_args: {'id': '84'} Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:39:34.468179 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:34.469110 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.470687 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-6f231841-4594-429b-99f3-d273754d7752 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:39:34.471903 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-6f231841-4594-429b-99f3-d273754d7752 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387967 Oct 04 08:39:34.471903 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 08:39:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:34.478034 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-d490c2d5-85a4-4b64-aeea-e44b540f9e08 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:34.492663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-d490c2d5-85a4-4b64-aeea-e44b540f9e08 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018169 Oct 04 08:39:34.493468 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 08:39:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:34.503150 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-5fff7c54-ce67-4642-a608-57eda005849c admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:34.519227 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-5fff7c54-ce67-4642-a608-57eda005849c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020192 Oct 04 08:39:34.519742 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 08:39:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:34.528603 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-429ae2e7-f7da-4f1a-8263-55fe1838ee8b admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:34.534503 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.wsgi [None req-429ae2e7-f7da-4f1a-8263-55fe1838ee8b admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-429ae2e7-f7da-4f1a-8263-55fe1838ee8b admin admin] Request method failure captured: Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Accept: application/json Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Accept-Encoding: gzip, deflate Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Connection: keep-alive Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Content-Length: 0 Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Host: 10.222.0.26 Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Openstack-Api-Version: compute 2.92 Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Openstack-System-Scope: None Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: User-Agent: python-novaclient Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Auth-Token: gAAAAABjO_FFestdR0magM9SphpYfuqPjyx7cGf_KW57jmpwPBT3sKqyQfaSt4qvnps-wEDQ9JTaJsugiXjnoaHW_vLo2IdA0sM9kG5Qn34lXe8msDa2fGm-Z1Z1N8VSGsEcC13RtHDNcAZx4JDAajxE0xYeu5OOJ2S5-g5gwyRfFZU8lqryZm4 Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Domain-Id: None Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Domain-Name: None Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Identity-Status: Confirmed Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Is-Admin-Project: True Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Domain-Id: default Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Domain-Name: Default Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Name: admin Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Role: reader,admin,member Oct 04 08:39:34.536005 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Roles: reader,admin,member Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}] Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant: admin Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant-Name: admin Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User: admin Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Domain-Id: default Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Domain-Name: Default Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Id: f84b5144054d4e158a838b4ae551996f Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Name: admin Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: method: > Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: exception: Flavor 84 could not be found. Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: action_args: {'id': '84'} Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:39:34.537722 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:34.538918 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:34.540340 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-429ae2e7-f7da-4f1a-8263-55fe1838ee8b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:39:34.541570 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-429ae2e7-f7da-4f1a-8263-55fe1838ee8b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012239 Oct 04 08:39:34.541570 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 08:39:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:35.736561 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-5fff7c54-ce67-4642-a608-57eda005849c admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:35.737561 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-5fff7c54-ce67-4642-a608-57eda005849c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 04 08:39:35.737987 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:36.260294 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-82bacc41-09d5-4634-ae76-faf191c4db3a admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:36.266061 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.wsgi [None req-82bacc41-09d5-4634-ae76-faf191c4db3a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-82bacc41-09d5-4634-ae76-faf191c4db3a admin admin] Request method failure captured: Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Accept: application/json Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Accept-Encoding: gzip, deflate Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Connection: keep-alive Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Content-Length: 0 Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Host: 10.222.0.26 Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Openstack-Api-Version: compute 2.92 Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Openstack-System-Scope: None Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: User-Agent: python-novaclient Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Auth-Token: gAAAAABjO_FHn0hsfcFJK3qWqYAYg59xAiQNB1P867ObZxLvQIv8XXYhgPZNIfyA_X9JW-9xxvq0to08ogh24JcFmuPhaJJAOBusjMpq0hN5jF6OMPUIwZdDkxfRmDURcR9RRI6-JlqQxCDs6OjCU3EophiKaK5c3F--TGrqyLpcuaDIxwrcAGw Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Domain-Id: None Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Domain-Name: None Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Identity-Status: Confirmed Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Is-Admin-Project: True Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Domain-Id: default Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Domain-Name: Default Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Project-Name: admin Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Role: reader,admin,member Oct 04 08:39:36.267574 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Roles: reader,admin,member Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}] Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant: admin Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-Tenant-Name: admin Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User: admin Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Domain-Id: default Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Domain-Name: Default Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Id: f84b5144054d4e158a838b4ae551996f Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: X-User-Name: admin Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: method: > Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: exception: Flavor 451 could not be found. Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: action_args: {'id': '451'} Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:39:36.269214 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:36.270261 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.271663 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-82bacc41-09d5-4634-ae76-faf191c4db3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:39:36.273198 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-82bacc41-09d5-4634-ae76-faf191c4db3a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393503 Oct 04 08:39:36.273198 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 08:39:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:36.279034 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-ac33bac7-107e-4b1d-89e6-1a4ef15c7fea admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:36.293924 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-ac33bac7-107e-4b1d-89e6-1a4ef15c7fea admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018693 Oct 04 08:39:36.294464 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 08:39:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:36.304410 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:36.320754 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019819 Oct 04 08:39:36.321297 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 08:39:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:39:36.330583 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-68eb93a2-cb69-47b7-8232-5748f839e3dc admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:36.335963 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.wsgi [None req-68eb93a2-cb69-47b7-8232-5748f839e3dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-68eb93a2-cb69-47b7-8232-5748f839e3dc admin admin] Request method failure captured: Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Accept: application/json Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Accept-Encoding: gzip, deflate Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Connection: keep-alive Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Content-Length: 0 Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Host: 10.222.0.26 Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Openstack-Api-Version: compute 2.92 Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Openstack-System-Scope: None Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: User-Agent: python-novaclient Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Auth-Token: gAAAAABjO_FHn0hsfcFJK3qWqYAYg59xAiQNB1P867ObZxLvQIv8XXYhgPZNIfyA_X9JW-9xxvq0to08ogh24JcFmuPhaJJAOBusjMpq0hN5jF6OMPUIwZdDkxfRmDURcR9RRI6-JlqQxCDs6OjCU3EophiKaK5c3F--TGrqyLpcuaDIxwrcAGw Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Domain-Id: None Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Domain-Name: None Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Identity-Status: Confirmed Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Is-Admin-Project: True Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Domain-Id: default Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Domain-Name: Default Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Project-Name: admin Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Role: reader,admin,member Oct 04 08:39:36.337459 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Roles: reader,admin,member Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47b3fa8678ad4f779e78d8c72364fac2"}]}] Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant: admin Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant-Id: 47b3fa8678ad4f779e78d8c72364fac2 Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-Tenant-Name: admin Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User: admin Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Domain-Id: default Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Domain-Name: Default Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Id: f84b5144054d4e158a838b4ae551996f Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: X-User-Name: admin Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: method: > Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: exception: Flavor 451 could not be found. Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: action_args: {'id': '451'} Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:39:36.339251 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:36.340230 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: ERROR nova.api.openstack.wsgi Oct 04 08:39:36.341560 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-68eb93a2-cb69-47b7-8232-5748f839e3dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:39:36.343141 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-68eb93a2-cb69-47b7-8232-5748f839e3dc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011797 Oct 04 08:39:36.343141 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 08:39:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:37.591091 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:37.592092 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 04 08:39:37.592482 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:38.108291 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-46b44a40-f44d-4b84-8150-5b0a4036c9cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:38.127942 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-46b44a40-f44d-4b84-8150-5b0a4036c9cc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397686 Oct 04 08:39:38.128485 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 08:39:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:39:39.348398 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:39.349386 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 04 08:39:39.349802 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:39.867258 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-b8018c07-7cb5-458f-9592-db39de7bbf3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:39.885292 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-b8018c07-7cb5-458f-9592-db39de7bbf3f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400243 Oct 04 08:39:39.885889 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 08:39:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:39:41.104215 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:41.105216 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 04 08:39:41.105611 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:41.623048 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-00fb5148-b813-4b1c-85b3-17d29b6ceffb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:41.642142 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-00fb5148-b813-4b1c-85b3-17d29b6ceffb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399603 Oct 04 08:39:41.642674 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 08:39:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:39:42.848888 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:42.849931 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 04 08:39:42.850332 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:43.366292 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-3bda9688-f652-4768-9d0d-f740703e391d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:39:43.384634 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-3bda9688-f652-4768-9d0d-f740703e391d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397160 Oct 04 08:39:43.385207 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 08:39:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:39:44.645021 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:44.646058 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 04 08:39:44.646457 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:39:45.187365 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-3060b9db-4998-4af7-851e-63940b48282b admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:39:45.208053 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-3060b9db-4998-4af7-851e-63940b48282b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.425464 Oct 04 08:39:45.208584 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Oct 4 08:39:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:40:41.475428 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:40:41.476698 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-ec32b963-1229-47c0-b687-520e9a16c8e2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Oct 04 08:40:41.477127 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 08:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:40:41.488197 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:41.861773 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-4c0a7017-f8f6-41fb-b7a7-d2734a7114a4 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:40:41.882044 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-4c0a7017-f8f6-41fb-b7a7-d2734a7114a4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398733 Oct 04 08:40:41.882594 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 08:40:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:40:41.903752 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_api:SELECT=14 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:41.908121 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-3560758d-f39a-4240-9a5e-55ef7d4eae86 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:40:41.915385 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-3560758d-f39a-4240-9a5e-55ef7d4eae86 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013047 Oct 04 08:40:41.915894 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Oct 4 08:40:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:40:41.927833 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-5d899562-6d79-40f6-ad06-6763ad7db765 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:40:41.935030 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-5d899562-6d79-40f6-ad06-6763ad7db765 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010780 Oct 04 08:40:41.935534 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Oct 4 08:40:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:40:41.946567 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:40:41.953570 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010385 Oct 04 08:40:41.954124 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Oct 4 08:40:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:40:41.964892 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-1d886c41-3002-44ff-99a9-be54c70bb520 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:40:41.972581 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-1d886c41-3002-44ff-99a9-be54c70bb520 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011042 Oct 04 08:40:41.973087 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Oct 4 08:40:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:43:40.444249 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:40.445259 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 04 08:43:40.445652 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:43:40.586363 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_api:SELECT=6 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.750620 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:40.755424 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:40.755913 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:40.756339 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:40.757067 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:40.757509 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:40.757948 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:40.789255 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-6ddd32aa-595f-4d8e-ad76-1abb0aff623a admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.204248 Oct 04 08:43:40.789818 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 08:43:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:43:41.858180 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:41.859165 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 04 08:43:41.859547 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:43:42.050991 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:42.054373 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:42.054849 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:42.055273 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:42.055985 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:42.056425 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:42.056841 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:42.076311 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-dd9969ad-2c18-4b11-bee9-febf25ad7d63 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076636 Oct 04 08:43:42.076849 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 08:43:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:43:53.549515 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:53.550537 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 04 08:43:53.550928 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:43:53.693248 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_cell0:SELECT=4 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.694003 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_cell1:SELECT=4 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.694668 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG dbcounter [-] [111924] Writing DB stats nova_api:SELECT=8 {{(pid=111924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.742536 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:53.746068 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:53.746542 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:53.746969 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:53.747713 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:53.748158 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:53.748601 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:53.774133 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-4d38b81b-b8ae-452b-a747-60da8c0f3b1b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085375 Oct 04 08:43:53.774675 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 37/74] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 08:43:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:43:54.833237 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG nova.api.openstack.wsgi [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] Calling method '>' {{(pid=111923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:54.834372 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: INFO nova.api.openstack.requestlog [None req-37d47190-fe31-49f4-95c8-d469ac5ee2d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 04 08:43:54.834804 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: [pid: 111923|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 08:43:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:43:55.025778 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG nova.api.openstack.wsgi [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] Calling method '>' {{(pid=111924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:55.029735 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:55.030217 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:55.030675 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:55.031387 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:55.031835 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:55.032249 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: DEBUG oslo_concurrency.lockutils [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:55.054079 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: INFO nova.api.openstack.requestlog [None req-526eb49d-4739-49e4-b5c2-7ff42fcfaac8 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078518 Oct 04 08:43:55.054622 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: [pid: 111924|app: 0|req: 38/76] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 08:43:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:44:53.840513 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: Tue Oct 4 08:44:53 2022 - graceful shutdown triggered... Oct 04 08:44:53.839455 dv-cinder-860212-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 08:44:53.841480 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: Gracefully killing worker 1 (pid: 111923)... Oct 04 08:44:53.842214 dv-cinder-860212-1-iscsi devstack@n-api.service[111924]: Gracefully killing worker 2 (pid: 111924)... Oct 04 08:44:53.965699 dv-cinder-860212-1-iscsi devstack@n-api.service[111923]: DEBUG dbcounter [-] [111923] Writing DB stats nova_api:SELECT=4 {{(pid=111923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:54.840480 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: worker 1 buried after 1 seconds Oct 04 08:44:54.840756 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: worker 2 buried after 1 seconds Oct 04 08:44:54.840756 dv-cinder-860212-1-iscsi devstack@n-api.service[111922]: goodbye to uWSGI. Oct 04 08:44:54.842395 dv-cinder-860212-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 04 08:44:54.843170 dv-cinder-860212-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 08:44:54.846185 dv-cinder-860212-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 08:44:54.857215 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:44:54 2022] *** Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: nodename: dv-cinder-860212-1-iscsi Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: machine: x86_64 Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: clock source: unix Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: pcre jit disabled Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: detected number of CPU cores: 4 Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: current working directory: / Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: your processes number limit is 47680 Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: your memory page size is 4096 bytes Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: detected max file descriptor number: 2048 Oct 04 08:44:54.859261 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: lock engine: pthread robust mutexes Oct 04 08:44:54.860173 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: thunder lock: enabled Oct 04 08:44:54.860173 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 08:44:54.860173 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:44:54.898330 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: Python main interpreter initialized at 0x5635245a19c0 Oct 04 08:44:54.898330 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: python threads support enabled Oct 04 08:44:54.898330 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: your server socket listen backlog is limited to 100 connections Oct 04 08:44:54.898330 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:44:54.898799 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:44:54.898799 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: *** Operational MODE: preforking *** Oct 04 08:44:54.899055 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:44:54.899055 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: spawned uWSGI master process (pid: 126923) Oct 04 08:44:54.899263 dv-cinder-860212-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 08:44:54.901878 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: spawned uWSGI worker 1 (pid: 126938, cores: 1) Oct 04 08:44:54.901878 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: spawned uWSGI worker 2 (pid: 126939, cores: 1) Oct 04 08:44:54.901878 dv-cinder-860212-1-iscsi devstack@n-api.service[126923]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:44:55.563812 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:44:55.567234 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:44:56.730904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:44:56.730904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: from cryptography.utils import int_from_bytes Oct 04 08:44:56.731586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:44:56.731586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: from cryptography.utils import int_from_bytes Oct 04 08:44:56.736061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:44:56.736061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: from cryptography.utils import int_from_bytes Oct 04 08:44:56.736552 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:44:56.736552 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: from cryptography.utils import int_from_bytes Oct 04 08:44:59.141001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:44:59.141549 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:44:59.141646 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:44:59.142055 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:44:59.142139 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:44:59.142213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:44:59.142298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:44:59.142608 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:44:59.142711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:44:59.142797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.142974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:44:59.143147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.143318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.143477 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.143637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.143785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.143955 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.144136 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.144300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.144398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.144618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.144727 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.144936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.145046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.145263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.145373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.145591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.145734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.145932 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.146037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.146221 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.146404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-1-iscsi {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.146567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.146750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.147010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-1-iscsi {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.147180 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.147334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.147478 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.147649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.147843 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.148002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.148151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.148306 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.148458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.148607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.148756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.148910 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.149084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.149261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.149785 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.149965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.150139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.150315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.150470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.150622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.150775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.150950 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.151107 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.151258 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.151401 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.151555 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.151705 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.151858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.152010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.152174 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.152319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.152462 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.152612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.152764 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.152915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.153199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-1-iscsi {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.153366 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-1-iscsi {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.153526 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.153710 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.153875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.154028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.154179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.154355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.154560 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.154737 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.154904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.155050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.155202 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.155346 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.155500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.155655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.155810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.155964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.156116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.156285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.156430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.156578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.156801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.156957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.157206 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.157369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.157522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.157674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.157924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.158081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.158232 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.158394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.158556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.158700 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.158848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.158991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.159150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.159299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.159450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.159767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.160004 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.160160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.160321 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.160477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.160620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.160780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.160930 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.161080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.161232 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.161379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.161534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.161702 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.161868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.162031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.162186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.162349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.162502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.162655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.162876 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.163030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.163200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.163484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.163647 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.163966 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.164130 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.164275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.164426 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.164582 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.164733 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.164877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.165032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.165184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.165335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.165478 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.165629 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.165833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.165992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.166147 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.166290 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.166432 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.166596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.166751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.166996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.167173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.167400 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.167400 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.168217 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.168217 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.168507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.168649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.168792 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.168935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.169077 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.169255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.169407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.169551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.169735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.170038 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.170254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.170412 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.170567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.170712 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.170862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.171012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.171164 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.171322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.171476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.171630 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.171781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.171932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172375 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172965 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.172965 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.173253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.173253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.173764 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.173921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.174076 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.174232 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.174376 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.174517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.174659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.174800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.174952 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.175096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.175243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.175404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.175555 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.175707 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.175857 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.176008 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.176153 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.176302 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.176451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.176608 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.176752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.176909 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.177136 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.177293 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.177533 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.177750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.177913 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.178108 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.178260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.178403 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.178553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.178709 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.178854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.178995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.179154 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.179312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.179455 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.179612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.179768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.179935 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.180243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.180466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.180617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.180834 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.180993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.181144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.181292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.181443 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.181593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.181764 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.181933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.182077 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.182220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.182378 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.182540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.182693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.182837 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.182986 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.183912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.184078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.184233 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.184385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.184549 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.184699 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.184841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.184983 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.185134 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.185284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.185434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.185589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.185776 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.185934 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.186091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.186235 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.186393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.186548 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.186707 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.186863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.187051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.187278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.187437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.187670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.187862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.188241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.188401 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.188581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.188741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.188741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.189024 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.189176 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.189330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.189482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.189625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.189804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.189950 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.190102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:44:59.190402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.190651 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.194099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.194278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.194456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.195835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.196007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.196162 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.196322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.196480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.197182 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.197376 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.197542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.197732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.197897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.198050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.198207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.198414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.198559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.198730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.198882 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.199109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.199264 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.199572 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.199740 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.199902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.200740 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.200912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.201239 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.201390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.201504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.201819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.201980 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.202144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.202917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.203477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.203668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.203818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.203972 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.205548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.205746 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.205916 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.206064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.206208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.206371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.206533 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.206679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.206822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.206965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.207108 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.207264 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.207409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.207562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.207713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.207867 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.208009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.208167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.208360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.208522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.208675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.208825 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.209653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.209854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.210002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.210154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.210300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.210452 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.210773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.210931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.211045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.211164 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.211451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.211600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.211936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.212580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.212739 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.213018 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.213210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.213493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.213656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.214581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.214791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.215086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.215285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.215466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.215671 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.216012 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.216159 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.216303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.216446 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.216626 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.217199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.217371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.217525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.217670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.217839 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.217983 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.218844 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.219103 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.219313 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.219502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.219707 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.219869 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.220013 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.220166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.220408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.220568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.222087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.222898 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.223030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.223186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.223299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.223547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.223795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.223984 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.224169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.224353 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.224580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.224741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.224897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.225042 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.225361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.225523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.226683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.226891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.227053 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.227207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.227394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.227544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.227694 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.227869 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.228014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.228157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.228306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.228450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.228672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.228838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.228991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.229135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.229296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.229483 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.229640 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.230893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.231073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.231221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.231367 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.231553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.231721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.231875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.232026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.232179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.232332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.232476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.232634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.232815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.232979 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.233122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.233265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.233425 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.233581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.233747 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.233909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.234420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.234576 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.234720 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.234876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.235020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.235170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.235625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.235821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.236031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.236909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.237078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.237231 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.237382 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.237544 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.237765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.237934 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.238086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.238237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.238386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.238547 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.238761 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.238923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.239386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.239557 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.239756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.239931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.240742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.241035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.241195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.242202 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.242383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.242568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.242913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.243093 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.243248 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.243399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.243591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.243798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.243963 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.244123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.244283 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.244439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.244597 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.244762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.245169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.245343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.247930 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.248113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.248269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.248436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.248589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.248783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.248942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.249092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.249256 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.249406 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.249564 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.249779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.249937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.250087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.250286 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.250449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.250600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.250758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.250917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.251068 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.251236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.251394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.251545 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.251695 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.251854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.252010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.252173 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.252323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.252471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.252620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.252777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.252926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.253084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.253278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.253441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.253599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.253772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.253956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.254116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.254267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.254415 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.254572 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.254734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.254893 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.255043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.255199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.255357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.255507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.255664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.255838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.256032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.256186 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.256344 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.256556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.256746 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.256912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.258932 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.259109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.259359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.259529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.259766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.260040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.260251 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.260411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.260563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.260563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.260875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.261138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.261363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.261530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.261683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.261874 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.262042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.262202 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.262496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.262674 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.262826 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.262983 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.263145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.263303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.263460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.264117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.264281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.264432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.264598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.264749 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.264899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.265057 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.265229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.265399 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.265557 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.265817 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.265975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.266389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.266551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.266713 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.266865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.269008 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.269190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.269384 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.269544 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.269739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.269914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.270067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.270217 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.270373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.270537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.270705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.270866 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.271016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.271164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.271315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.271474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.271648 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.271808 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.271966 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.272152 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.272308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.272473 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.272633 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.272782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.272940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.273098 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.273256 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.273420 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.273570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.273917 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.274089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.274248 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.274406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.274578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.274730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.274886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.274886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.275187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.275347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.275498 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.275655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.275808 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.275977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.276127 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.276291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.276442 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.276875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.277041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.277193 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.277352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.279300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.279542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.279752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.280002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.280300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.280485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.280728 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.280947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.281135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.281325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.281490 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.281652 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.282024 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.282221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.282535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.282704 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.282865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.283102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.283308 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.283521 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.284026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.284191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.284343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.284504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.284656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.284816 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.285244 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.285407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.285604 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.285806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.286165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.286327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.286478 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.286627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.286791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.286942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.287101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.287292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.287452 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.287637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.287891 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.288067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.288483 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.288662 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.288816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.288816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.289160 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.289324 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.289514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.289708 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.289868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.290042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.290203 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.290368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.290534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.290706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.290864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.291021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.291184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.291335 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.291485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.291634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.291815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.291978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.292141 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.292292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.292959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.293122 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.293283 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.293468 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.293640 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.293851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.294014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.294171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.294320 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.294469 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.294634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.294792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.294941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.295090 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.295248 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.295408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.295408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.295408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.295895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.296049 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.296198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.296362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.296520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.296671 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.296829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.297010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.297165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.297328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.297534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.297706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.298132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.298299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.298675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.298845 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.299042 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.299263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.299263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.299263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.299829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.300087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.300243 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.300439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.300439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.300439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.300921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.301081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.301280 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.301438 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.301625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.301804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.302007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.302124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.302242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.302474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.302474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.302771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.302930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.303093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.303368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.303528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.303751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.303960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.304156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.304365 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.304596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.304789 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.304957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.305119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.305278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.305478 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.305675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.305897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.306051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.306217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.306369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.306532 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.306690 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.307281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.307449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.307664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.307824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.307992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.308999 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.309161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.309376 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.309540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.309719 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.309888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.310040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.310197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.310411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.310567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.310730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.310882 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.311032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.311181 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.311382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.311589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.311745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.311896 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.312053 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.312215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.312381 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.312533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.312693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.312693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.312994 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.313154 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.313312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.313497 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.313659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.313860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.314020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.314184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.314336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.314486 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.314643 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.314804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.314954 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.315112 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.315262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.315411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.315595 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.315791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.315949 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.316109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.316296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.316455 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.316613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.316763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.316936 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.317095 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.317245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.317394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.317557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.317749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.317987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.318147 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.318399 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.318565 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.318565 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.318881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.319247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.319458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.319649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.319841 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.319993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.320142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.320301 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.320468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.320619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.320777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.320937 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.321096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.321253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.321410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.321571 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.321741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.321928 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.322091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.322249 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.322406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.322570 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.322720 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.322870 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.323033 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.323190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.323355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.323523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.323739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.323935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.323935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.324238 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.324425 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.324585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.324743 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.324906 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.325065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.325215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.325364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.325513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.325673 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.325976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.326130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.326288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.326437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.326595 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.326745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.326904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.327062 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.327214 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.327369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.327519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.327680 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.327888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.328050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.328203 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.328375 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.328609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.328764 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.328933 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.329297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.329511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.329511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.329926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.329926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.329926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.329926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.330563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.330715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.330873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.331033 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.331191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.331351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.331501 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.331651 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.331807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.332044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.332204 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.332355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.332553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.332708 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.332858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.333016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.333167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.333316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.333467 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.333624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.333813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.333967 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.334117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.334266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.334441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.334608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.334773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.334931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.334931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.335226 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.335226 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.335510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.335669 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.335820 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.335970 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.336119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.336275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.336451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.336612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.336763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.336920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.337071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.337222 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.337386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.337551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.337754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.338086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.338245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.338404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.338581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.338817 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.338973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.339123 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.340080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.340252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.340423 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.340423 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.340775 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.341542 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.341542 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.341542 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.342039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.342191 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.342191 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.342705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.342878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.343131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.343286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.343286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.343286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.343715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.343880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.343880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.344187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.344397 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.344561 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.344720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.344872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.345022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.345171 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.345330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.345330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.345614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.345811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.345966 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.346127 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.346127 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.346708 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.346859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.347016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.347181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.347338 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.347502 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.347653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.347809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.347958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.348239 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.348404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.348566 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.348728 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.348985 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.348985 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.349309 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.349460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.349460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.349460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.349995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.350357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.350588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.350741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.350898 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.351051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.351215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.351375 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.351533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.351684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.351833 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.351983 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.352132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.352291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.352291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.352586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.352744 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.352894 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.353062 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.353227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.353386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.353543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.353735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.354151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.354301 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.354451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.354603 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.354757 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.354900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.355096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.355245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.355416 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.355575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.355752 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.355904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.356072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.356289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.356431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.356568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.356731 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.356880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.357033 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.357189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.357355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.357526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.357702 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.357862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.358013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.358190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.358426 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.358583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.358583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.358876 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.359133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.359292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.359442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.359600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.359758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.359922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360387 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360633 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.360726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361033 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361127 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361394 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.361999 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362170 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362354 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362729 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.362916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363011 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363196 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363381 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.363943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364346 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364441 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364885 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.364968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365051 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365134 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365238 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365425 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365604 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.365961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366338 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366677 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.366956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367411 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367592 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367677 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367760 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.367945 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368478 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368882 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.368975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369226 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369390 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369560 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369752 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369848 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.369948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.370041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.370127 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.370317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.370529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.370529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.371925 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372852 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.372955 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373648 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.373941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374033 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374118 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374201 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374420 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374420 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374608 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.374967 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375052 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375803 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.375980 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376232 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376325 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376421 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376598 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376690 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376775 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.376953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377212 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377576 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377660 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377808 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377894 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377988 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.377988 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378919 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.378998 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379139 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379286 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379366 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379515 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379828 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379911 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.379984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380053 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380565 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380776 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.380925 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381083 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381154 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381456 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381456 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381595 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381902 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.381982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382521 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.382976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383410 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383488 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383677 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383811 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.383941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384176 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384571 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384709 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384892 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.384978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385075 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385162 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385162 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.385899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.386037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.386140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.386271 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.386838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.386934 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387030 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387030 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387310 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387680 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387787 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.387965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388052 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388400 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388472 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388662 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.388994 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389077 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389353 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389723 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.389900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390036 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390220 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390536 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390638 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.390912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391006 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391695 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.391866 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392141 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392483 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.392953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393139 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393239 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393417 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393602 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.393960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394054 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394642 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394722 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394946 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394946 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.394946 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395446 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395633 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395727 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.395922 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.396945 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397205 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.397913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398255 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398628 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.398992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399288 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399382 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.399923 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400492 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400861 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.400955 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401217 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401413 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401499 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401584 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401667 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401834 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.401947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402130 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402239 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402432 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402774 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.402952 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403739 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.403996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404172 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404252 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404426 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404604 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404774 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.404933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405078 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405423 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405515 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.405918 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406203 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406527 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.406978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407062 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407411 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407503 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407695 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.407951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408222 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408856 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.408856 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409520 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.409959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.410712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.411032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.411164 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.411479 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.411797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.412116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.412431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.412743 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.413059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.413393 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.413754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.414056 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.414386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.414709 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.415101 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.415348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.415664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.415999 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.416313 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.416629 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.416948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.417266 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.417609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.417957 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.418275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.418617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.418937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.419257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.419588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.419917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.420263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.420553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.420882 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.421231 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.421546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.421916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.422249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.422564 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.422879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.423188 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:44:59.423430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:44:59.468443 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO dbcounter [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Registered counter for database nova_api Oct 04 08:44:59.485485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO dbcounter [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Registered counter for database nova_api Oct 04 08:44:59.488669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_db.sqlalchemy.engines [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.495230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writer thread running {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:44:59.505848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_db.sqlalchemy.engines [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.512945 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writer thread running {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:44:59.551361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.context [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cae228f-af20-4704-b46a-066502ec8d5b(cell1) {{(pid=126938) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:44:59.555369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:44:59.555843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:44:59.557402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:44:59.558690 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:44:59.559133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:44:59.561243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:44:59.563246 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO dbcounter [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Registered counter for database nova_cell0 Oct 04 08:44:59.567264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO dbcounter [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Registered counter for database nova_cell1 Oct 04 08:44:59.568406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.context [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2cae228f-af20-4704-b46a-066502ec8d5b(cell1) {{(pid=126939) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:44:59.572402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:44:59.572853 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:44:59.575071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:44:59.575200 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_db.sqlalchemy.engines [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.575841 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:44:59.576285 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:44:59.577321 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_db.sqlalchemy.engines [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.578354 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:44:59.580371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO dbcounter [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Registered counter for database nova_cell0 Oct 04 08:44:59.582427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writer thread running {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:44:59.584445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO dbcounter [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Registered counter for database nova_cell1 Oct 04 08:44:59.587665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writer thread running {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:44:59.591278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_db.sqlalchemy.engines [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.593406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_db.sqlalchemy.engines [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.598207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writer thread running {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:44:59.733135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO dbcounter [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Registered counter for database nova_cell0 Oct 04 08:44:59.739609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writer thread running {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:44:59.739810 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_db.sqlalchemy.engines [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.744192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writer thread running {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:44:59.750085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO dbcounter [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Registered counter for database nova_cell0 Oct 04 08:44:59.756569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_db.sqlalchemy.engines [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:44:59.760910 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writer thread running {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:45:00.065977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: WARNING keystonemiddleware.auth_token [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:45:00.073283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: WARNING keystonemiddleware.auth_token [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:45:00.087976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: WARNING keystonemiddleware.auth_token [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:45:00.095824 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: WARNING keystonemiddleware.auth_token [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:45:00.426790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: WARNING keystonemiddleware.auth_token [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:45:00.432858 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: WARNING keystonemiddleware.auth_token [None req-f9648582-a2f6-479d-9e27-c5a6d628c8a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:45:00.438556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635245a19c0 pid: 126938 (default app) Oct 04 08:45:00.441739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: WARNING keystonemiddleware.auth_token [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:45:00.447759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: WARNING keystonemiddleware.auth_token [None req-3346a24b-0d1a-4994-9e3e-45450ac62a73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:45:00.453553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635245a19c0 pid: 126939 (default app) Oct 04 08:45:36.820447 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.821750 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.823118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.824559 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.901776 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.909349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.918074 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.920444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:37.611348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cfeb573e-7ef9-45bf-a7ee-afac8c9f8541 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Action: 'create', calling method: .version_select at 0x7f5fd526d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1408798058"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:37.907351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e6166b9d-2924-49f2-b8e8-e4302c06cfcf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Action: 'create', calling method: .version_select at 0x7f5fd526c4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1433006361", "metadata": {"Type": "work"}}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e6166b9d-2924-49f2-b8e8-e4302c06cfcf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Request method failure captured: Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 122 Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwFL97RmDl43pXfND99R_dbBOfvGQuusQqPcHNRNexHXAq2GaSUAc_35oz5GbFtgjFVJTuJTDokmW8B9GEYtrzZiQhMttG1Vl1bf5V3_ZAadRxELiM3L956IC6xfRQ7WNKLKj3bqxSCsWNdJobL4iStbgALKyEVLrE9Gq_90H4c00 Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:37.917358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/832db97796824ce793ef6afc423c1c12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_832db97796824ce793ef6afc423c1c12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}] Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 2f84f6f1ccf74df9aa7105448a7b774b Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1433006361", "metadata": {"Type": "work"}}} Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:37.919130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1433006361', 'metadata': {'Type': 'work'}}}} Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:37.920377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:45:37.922042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:45:37.924798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:45:37.924798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.924798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e6166b9d-2924-49f2-b8e8-e4302c06cfcf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:37.924798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e6166b9d-2924-49f2-b8e8-e4302c06cfcf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.110289 Oct 04 08:45:37.924798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 08:45:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:45:37.953595 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7788e505-c3a3-40b1-b452-0fb94ce964cf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Action: 'create', calling method: .version_select at 0x7f5fd526cdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1857139199", "metadata": {"Type": "work"}}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7788e505-c3a3-40b1-b452-0fb94ce964cf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Request method failure captured: Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 120 Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwFL97RmDl43pXfND99R_dbBOfvGQuusQqPcHNRNexHXAq2GaSUAc_35oz5GbFtgjFVJTuJTDokmW8B9GEYtrzZiQhMttG1Vl1bf5V3_ZAadRxELiM3L956IC6xfRQ7WNKLKj3bqxSCsWNdJobL4iStbgALKyEVLrE9Gq_90H4c00 Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:37.957906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/832db97796824ce793ef6afc423c1c12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_832db97796824ce793ef6afc423c1c12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}] Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 2f84f6f1ccf74df9aa7105448a7b774b Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1857139199", "metadata": {"Type": "work"}}} Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:37.959273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1857139199', 'metadata': {'Type': 'work'}}}} Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi '0' Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:37.960040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:45:37.961343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:45:37.965713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:45:37.965713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.968100 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7788e505-c3a3-40b1-b452-0fb94ce964cf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:37.969382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7788e505-c3a3-40b1-b452-0fb94ce964cf tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038656 Oct 04 08:45:37.971947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 08:45:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:45:37.986461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8c78781a-bb7e-4f96-ba92-15eebd2abedc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Action: 'create', calling method: .version_select at 0x7f5fd51291f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-463885025", "metadata": {"Type": "work"}}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8c78781a-bb7e-4f96-ba92-15eebd2abedc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Request method failure captured: Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 118 Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwFL97RmDl43pXfND99R_dbBOfvGQuusQqPcHNRNexHXAq2GaSUAc_35oz5GbFtgjFVJTuJTDokmW8B9GEYtrzZiQhMttG1Vl1bf5V3_ZAadRxELiM3L956IC6xfRQ7WNKLKj3bqxSCsWNdJobL4iStbgALKyEVLrE9Gq_90H4c00 Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:37.991128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/832db97796824ce793ef6afc423c1c12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_832db97796824ce793ef6afc423c1c12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}] Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 2f84f6f1ccf74df9aa7105448a7b774b Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-463885025", "metadata": {"Type": "work"}}} Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:37.992409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-463885025', 'metadata': {'Type': 'work'}}}} Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi '' Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:37.993177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:45:37.995088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:45:37.997226 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:45:37.997226 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.001069 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8c78781a-bb7e-4f96-ba92-15eebd2abedc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:38.002493 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8c78781a-bb7e-4f96-ba92-15eebd2abedc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021161 Oct 04 08:45:38.003272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 3/3] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 08:45:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:45:38.013525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0f33625c-f402-4d6c-8c73-fc2f3f9bc8a9 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Calling method '.version_select at 0x7f5fd5129c10>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.382834 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-0f33625c-f402-4d6c-8c73-fc2f3f9bc8a9 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] HTTP exception thrown: Volume tempest-invalid-1242141205 could not be found. Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0f33625c-f402-4d6c-8c73-fc2f3f9bc8a9 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Request method failure captured: Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1242141205 HTTP/1.1 Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwFL97RmDl43pXfND99R_dbBOfvGQuusQqPcHNRNexHXAq2GaSUAc_35oz5GbFtgjFVJTuJTDokmW8B9GEYtrzZiQhMttG1Vl1bf5V3_ZAadRxELiM3L956IC6xfRQ7WNKLKj3bqxSCsWNdJobL4iStbgALKyEVLrE9Gq_90H4c00 Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:38.387501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/832db97796824ce793ef6afc423c1c12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_832db97796824ce793ef6afc423c1c12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}] Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 2f84f6f1ccf74df9aa7105448a7b774b Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Volume tempest-invalid-1242141205 could not be found. Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'tempest-invalid-1242141205'} Oct 04 08:45:38.389165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1242141205 could not be found. (HTTP 404) (Request-ID: req-8a18b010-ffa6-4152-8e82-8b2ac68f7f13) Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.390133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:45:38.391896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1242141205 could not be found. Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:38.393711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1242141205 could not be found. Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1242141205 could not be found. Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.395470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0f33625c-f402-4d6c-8c73-fc2f3f9bc8a9 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Returning 404 to user: Volume tempest-invalid-1242141205 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:38.397128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0f33625c-f402-4d6c-8c73-fc2f3f9bc8a9 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1242141205" status: 404 len: 99 microversion: 2.1 time: 0.387492 Oct 04 08:45:38.403722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 4/4] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 4 08:45:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1242141205 => generated 99 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 08:45:38.410500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7391b633-3d0c-4b10-9daf-a1bada29765a tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005414 Oct 04 08:45:38.414887 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 5/5] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 4 08:45:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 08:45:38.427592 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ccd844ff-2476-4e1b-bddc-51f6baa2bd70 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009434 Oct 04 08:45:38.428445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 6/6] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 08:45:38.442290 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-044c65ba-1aec-4dce-aa99-71a05e99abfc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Calling method '.version_select at 0x7f5fd50aee50>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.506546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-044c65ba-1aec-4dce-aa99-71a05e99abfc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] HTTP exception thrown: Volume 8723c2af-fabe-4c66-9891-c018b170837a could not be found. Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-044c65ba-1aec-4dce-aa99-71a05e99abfc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Request method failure captured: Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/os-volumes/8723c2af-fabe-4c66-9891-c018b170837a HTTP/1.1 Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwFL97RmDl43pXfND99R_dbBOfvGQuusQqPcHNRNexHXAq2GaSUAc_35oz5GbFtgjFVJTuJTDokmW8B9GEYtrzZiQhMttG1Vl1bf5V3_ZAadRxELiM3L956IC6xfRQ7WNKLKj3bqxSCsWNdJobL4iStbgALKyEVLrE9Gq_90H4c00 Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:38.508563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/832db97796824ce793ef6afc423c1c12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_832db97796824ce793ef6afc423c1c12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}] Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 2f84f6f1ccf74df9aa7105448a7b774b Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Volume 8723c2af-fabe-4c66-9891-c018b170837a could not be found. Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '8723c2af-fabe-4c66-9891-c018b170837a'} Oct 04 08:45:38.510175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8723c2af-fabe-4c66-9891-c018b170837a could not be found. (HTTP 404) (Request-ID: req-54032b3b-357c-477d-a865-34a04d840b51) Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.511079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:45:38.512261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8723c2af-fabe-4c66-9891-c018b170837a could not be found. Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:45:38.513607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8723c2af-fabe-4c66-9891-c018b170837a could not be found. Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8723c2af-fabe-4c66-9891-c018b170837a could not be found. Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-044c65ba-1aec-4dce-aa99-71a05e99abfc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Returning 404 to user: Volume 8723c2af-fabe-4c66-9891-c018b170837a could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-044c65ba-1aec-4dce-aa99-71a05e99abfc tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/8723c2af-fabe-4c66-9891-c018b170837a" status: 404 len: 109 microversion: 2.1 time: 0.076600 Oct 04 08:45:38.515218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 7/7] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:45:38 2022] DELETE /compute/v2.1/os-volumes/8723c2af-fabe-4c66-9891-c018b170837a => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:45:38.522417 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-01a82d7d-3bc2-4289-81a3-bc52b814d3d6 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Calling method '.version_select at 0x7f5fd505d5e0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.582061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-01a82d7d-3bc2-4289-81a3-bc52b814d3d6 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] HTTP exception thrown: Volume 3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c could not be found. Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-01a82d7d-3bc2-4289-81a3-bc52b814d3d6 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Request method failure captured: Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/os-volumes/3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c HTTP/1.1 Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwFL97RmDl43pXfND99R_dbBOfvGQuusQqPcHNRNexHXAq2GaSUAc_35oz5GbFtgjFVJTuJTDokmW8B9GEYtrzZiQhMttG1Vl1bf5V3_ZAadRxELiM3L956IC6xfRQ7WNKLKj3bqxSCsWNdJobL4iStbgALKyEVLrE9Gq_90H4c00 Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:38.585818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/832db97796824ce793ef6afc423c1c12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_832db97796824ce793ef6afc423c1c12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/832db97796824ce793ef6afc423c1c12"}]}] Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 832db97796824ce793ef6afc423c1c12 Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesNegativeTest-917518517 Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 2f84f6f1ccf74df9aa7105448a7b774b Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesNegativeTest-917518517-project Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Volume 3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c could not be found. Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c'} Oct 04 08:45:38.587284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c could not be found. (HTTP 404) (Request-ID: req-be8065b8-f6fd-4a5b-bc98-76f879ccf0e0) Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.588593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:38.590015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c could not be found. Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:45:38.592256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c could not be found. Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c could not be found. Oct 04 08:45:38.594253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.598186 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-01a82d7d-3bc2-4289-81a3-bc52b814d3d6 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] Returning 404 to user: Volume 3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:38.598753 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-01a82d7d-3bc2-4289-81a3-bc52b814d3d6 tempest-VolumesNegativeTest-917518517 tempest-VolumesNegativeTest-917518517-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c" status: 404 len: 109 microversion: 2.1 time: 0.082663 Oct 04 08:45:38.610454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 8/8] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1/os-volumes/3f2426ab-f45c-4aaf-9b2a-633c89b9ac5c => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:45:38.786143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cfeb573e-7ef9-45bf-a7ee-afac8c9f8541 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.894629 Oct 04 08:45:38.787330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 1/9] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Oct 4 08:45:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1897 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 04 08:45:38.802329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2510f7ac-b421-4a63-8904-923eb87cf509 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50aed30>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.919941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2510f7ac-b421-4a63-8904-923eb87cf509 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 200 len: 345 microversion: 2.1 time: 0.121424 Oct 04 08:45:38.920698 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 9/10] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:39.941641 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a80052e9-320f-4c6d-8f68-86e546693a91 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd5140430>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:40.045722 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a80052e9-320f-4c6d-8f68-86e546693a91 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 200 len: 345 microversion: 2.1 time: 0.113904 Oct 04 08:45:40.047429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 2/11] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:45:39 2022] GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:41.059809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1d456ef0-6bd6-403b-b503-d320a6ebd71a tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd505d3a0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:41.436858 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1d456ef0-6bd6-403b-b503-d320a6ebd71a tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 200 len: 346 microversion: 2.1 time: 0.381336 Oct 04 08:45:41.445578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 10/12] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:45:41 2022] GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 346 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:41.453465 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-82688d7a-f53c-4e42-ba23-18b62ed4518a tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Action: 'create', calling method: .version_select at 0x7f5fd5140a60>, body: {"snapshot": {"volume_id": "f5cdd1a7-75a2-469b-9a58-63a5ef49835e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-226339006"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:42.078011 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-82688d7a-f53c-4e42-ba23-18b62ed4518a tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.630861 Oct 04 08:45:42.079319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 3/13] 10.222.0.26 () {60 vars in 1162 bytes} [Tue Oct 4 08:45:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:42.091664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4e9087f3-9e78-4e41-9f3c-6659dfb1ce04 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50680d0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:42.167852 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4e9087f3-9e78-4e41-9f3c-6659dfb1ce04 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.081357 Oct 04 08:45:42.168486 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 11/14] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:42 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:42.180439 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-881fcdb5-8215-41ac-99b7-a144a45f8146 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50d6d30>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:42.266428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-881fcdb5-8215-41ac-99b7-a144a45f8146 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.090371 Oct 04 08:45:42.267015 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 4/15] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 4 08:45:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:42.279829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-816d4ea5-703f-4e8d-bb6b-34e37da234e3 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd505d550>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:42.315132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-816d4ea5-703f-4e8d-bb6b-34e37da234e3 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.039538 Oct 04 08:45:42.316305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 12/16] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:42 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:43.331721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-967482d3-079d-46fd-ba36-a98633a8bba7 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd5a9baf0>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:43.394481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-967482d3-079d-46fd-ba36-a98633a8bba7 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.068930 Oct 04 08:45:43.395227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 5/17] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:43 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:44.409024 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5658c97-aca2-4276-b453-ccd20ca51a95 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50ae9d0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:44.489036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f5658c97-aca2-4276-b453-ccd20ca51a95 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.083174 Oct 04 08:45:44.491910 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 13/18] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:44 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:45.504200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9ac9fcf7-32d0-4e3a-9b71-4354b4c935b6 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd5140a60>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:45.556947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9ac9fcf7-32d0-4e3a-9b71-4354b4c935b6 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.056735 Oct 04 08:45:45.557513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 6/19] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:45 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:46.571409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f6872214-1b39-4cee-9dde-957f6fafcabe tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50681f0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:46.639120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f6872214-1b39-4cee-9dde-957f6fafcabe tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.073196 Oct 04 08:45:46.639674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 14/20] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:46 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:45:47.658638 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d8b1748b-53ff-4777-87cd-fc8898a7925c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd51403a0>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:47.793776 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d8b1748b-53ff-4777-87cd-fc8898a7925c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.144396 Oct 04 08:45:47.794442 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 7/21] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:47 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:48.822323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-377f8e47-a4de-47c5-8e0f-80b95c5a7290 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50ae940>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:48.872216 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-377f8e47-a4de-47c5-8e0f-80b95c5a7290 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.069372 Oct 04 08:45:48.872788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 15/22] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:48 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:49.342675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1239975395", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "networks": [{"uuid": "c8104de6-ee63-4839-95cd-2252ac786384"}]}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:49.593940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] validate_networks() for [('c8104de6-ee63-4839-95cd-2252ac786384', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:45:49.885021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e0034b48-b2ff-4741-b409-8b7b2855b031 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd505d790>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:49.941726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e0034b48-b2ff-4741-b409-8b7b2855b031 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.061148 Oct 04 08:45:49.947457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 16/23] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:49 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:50.955001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2587fd1e-defe-4556-80ce-ad8a6677fc43 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd5068700>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:51.005440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2587fd1e-defe-4556-80ce-ad8a6677fc43 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.054010 Oct 04 08:45:51.006397 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 17/24] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:50 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:51.478877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6a453af9-540b-4500-9c94-f505c574c116 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'create', calling method: .version_select at 0x7f5fd50688b0>, body: {"keypair": {"name": "tempest-keypair-2130639977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNS8Z+LkoLXQ53iS8RXQwB+Or/eJ7tmfoSsShpLNfvgM4Y7dZJhx05bgvQJ2aXRaNb1taAjQHF4BN93CKJP4/dJzX1qqc2qgcjQj8dtFmun998YOUMwmc7DjpGtbh+/jQ=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:51.609340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-6a453af9-540b-4500-9c94-f505c574c116 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for project ed8dda1234f54905962e427bf75e82c1. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:45:51.625265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-6a453af9-540b-4500-9c94-f505c574c116 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for user ed4b7bfb87b144b38b82514c17a468bc and project ed8dda1234f54905962e427bf75e82c1. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:45:51.723523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6a453af9-540b-4500-9c94-f505c574c116 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.557780 Oct 04 08:45:51.724932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 18/25] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 4 08:45:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 560 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:52.018297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7ec5edb8-66e7-4d5b-a4ae-2970a8c48a63 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50509d0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:52.081993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7ec5edb8-66e7-4d5b-a4ae-2970a8c48a63 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 287 microversion: 2.1 time: 0.067441 Oct 04 08:45:52.082744 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 19/26] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:52 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:45:52.095945 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-aa3e3755-45dd-4944-8ae0-cd85309fab6d tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd4ff70d0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:52.232669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-aa3e3755-45dd-4944-8ae0-cd85309fab6d tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 202 len: 0 microversion: 2.1 time: 0.141504 Oct 04 08:45:52.233652 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 20/27] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 4 08:45:52 2022] DELETE /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:45:52.241279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f405d74f-f2c5-4afd-9b0e-690ff830cf83 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd5050dc0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:52.298532 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f405d74f-f2c5-4afd-9b0e-690ff830cf83 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.060838 Oct 04 08:45:52.299371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 21/28] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:52 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:45:52.577031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:45:52.577593 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:45:52.577969 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:45:52.578380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:45:52.578817 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:45:52.609908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:45:52.610401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:45:52.610838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:45:52.611569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:45:52.612020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:45:52.612444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:45:52.710437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Getting quotas for project 7229cfcf52b64e83914f4ea2eb5627dd. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:45:52.725607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Getting quotas for user 980f097960df41528ac45d6c5a07c5f5 and project 7229cfcf52b64e83914f4ea2eb5627dd. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:45:52.754186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:45:52.761756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:45:52.907523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-097bc35d-dd52-465f-a991-2bad99c11886 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.887223 Oct 04 08:45:52.908695 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 8/29] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:45:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:45:52.921674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0ed71b84-3fa2-44e1-a1d7-ca62b106b493 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:52.922977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0ed71b84-3fa2-44e1-a1d7-ca62b106b493 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:45:53.312707 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bdd9fc5d-9915-49bd-9a3e-ca8d8e741a29 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd47ef5e0>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:53.397090 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bdd9fc5d-9915-49bd-9a3e-ca8d8e741a29 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.089553 Oct 04 08:45:53.397952 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 9/30] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:53 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:45:53.411764 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0ed71b84-3fa2-44e1-a1d7-ca62b106b493 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:45:53.463730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0ed71b84-3fa2-44e1-a1d7-ca62b106b493 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1215 microversion: 2.1 time: 0.543348 Oct 04 08:45:53.481129 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 22/31] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:45:52 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1215 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:54.415990 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2416a049-76c7-4aab-b427-c5cc5d3ea578 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd47ef940>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:54.482411 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2416a049-76c7-4aab-b427-c5cc5d3ea578 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.074999 Oct 04 08:45:54.482988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 10/32] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:54 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:54.487954 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cdbe427b-8948-432b-8c02-2492185c5e05 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:54.488525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cdbe427b-8948-432b-8c02-2492185c5e05 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:45:54.789484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cdbe427b-8948-432b-8c02-2492185c5e05 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:45:54.818551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cdbe427b-8948-432b-8c02-2492185c5e05 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1215 microversion: 2.1 time: 0.334479 Oct 04 08:45:54.819146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 11/33] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:45:54 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:55.123008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e3ee809b-f1a8-4589-9cd4-9a840afb3285 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: .version_select at 0x7f5fd512f1f0>, body: {"keypair": {"name": "tempest-keypair-814708181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAGWI4BnPLjmVBM2eXvWkAGxAV1c6gQ8M+DUsRaJQQePE6M8vWkV9O5otxkAcO4gwCsVqQXpcQhBxerZctR6XfkJk/UatwpAi9p8SEKICsrA3y4L4du9H6c/F7jPXGDOQ=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:55.168724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-e3ee809b-f1a8-4589-9cd4-9a840afb3285 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:45:55.189715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-e3ee809b-f1a8-4589-9cd4-9a840afb3285 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:45:55.266826 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e3ee809b-f1a8-4589-9cd4-9a840afb3285 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.830307 Oct 04 08:45:55.268698 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 23/34] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:45:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:45:55.496233 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2e78188c-e2a3-4d27-a0e8-5211c6d6a9be tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd47ef8b0>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:55.580405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2e78188c-e2a3-4d27-a0e8-5211c6d6a9be tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 200 len: 286 microversion: 2.1 time: 0.088665 Oct 04 08:45:55.581448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 12/35] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:55 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:55.843730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:55.845414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:45:55.876137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:45:55.878149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:45:55.881428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:45:55.885394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:45:55.886231 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:45:55.887793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:45:56.395208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:45:56.424576 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c79e02f1-2dc0-49b4-aa3a-bf7f283581fd tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1211 microversion: 2.1 time: 0.586140 Oct 04 08:45:56.428574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 24/36] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:45:55 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1211 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:56.593111 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d97da3ed-ea25-4a78-85cd-14f2bbdd95fc tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd47ef940>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:56.662837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-d97da3ed-ea25-4a78-85cd-14f2bbdd95fc tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] HTTP exception thrown: Snapshot 46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 could not be found. Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d97da3ed-ea25-4a78-85cd-14f2bbdd95fc tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Request method failure captured: Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 HTTP/1.1 Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_KwG9cjqE7p3zKZdbYZsIb11t-ksQkjYu4-EHNyFtuK2yePJg8mtS_tzeNxp9DIteCNCdh-2FEsSZ1gNP_ld_gN3-EUsEvAqotvsBHgDAiUKKXpUqGHPDZkShxYsLyiGdZrus_vKyZcc4LkOd9SU_h4fwlydcMJ3ugtjo6SDfWPfOo Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:45:56.668859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}] Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 973b2f1bc42a48a7bc488889d5565944 Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Snapshot 46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 could not be found. Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '46cb6edb-ac04-45d4-a49e-1f2f2d3902f4'} Oct 04 08:45:56.670402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 could not be found. (HTTP 404) (Request-ID: req-ffc0c116-1099-4750-b723-43eb805de56f) Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:45:56.671401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:56.672288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 could not be found. Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 08:45:56.673807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 could not be found. Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 could not be found. Oct 04 08:45:56.676257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:45:56.679331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d97da3ed-ea25-4a78-85cd-14f2bbdd95fc tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Returning 404 to user: Snapshot 46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:56.683303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d97da3ed-ea25-4a78-85cd-14f2bbdd95fc tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4" status: 404 len: 111 microversion: 2.1 time: 0.091426 Oct 04 08:45:56.685340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 13/37] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 08:45:56 2022] GET /compute/v2.1/os-snapshots/46cb6edb-ac04-45d4-a49e-1f2f2d3902f4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:45:56.694795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-28674531-ae3a-4a78-b79d-c10f6d092f9a tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd4f33f70>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:56.858999 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-28674531-ae3a-4a78-b79d-c10f6d092f9a tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 202 len: 0 microversion: 2.1 time: 0.169976 Oct 04 08:45:56.859880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 25/38] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:45:56 2022] DELETE /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:45:56.869330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-db19e1d8-35ab-4f29-a679-34f9d265695c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd47efd30>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:57.077428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-db19e1d8-35ab-4f29-a679-34f9d265695c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 200 len: 345 microversion: 2.1 time: 0.212772 Oct 04 08:45:57.078438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 14/39] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:45:56 2022] GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 345 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:57.449047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:57.450814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:45:57.472819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:45:57.475770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:45:57.477721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:45:57.479471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:45:57.481840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:45:57.482565 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:45:57.882386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:45:57.895463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fdd60e96-b735-4bdc-8145-3b05fe3287fc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1285 microversion: 2.1 time: 0.450786 Oct 04 08:45:57.913190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 26/40] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:45:57 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1285 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:58.101131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c40169ab-6ed7-445b-8e83-e258eaed10aa tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd4eeaaf0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:58.160171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-c40169ab-6ed7-445b-8e83-e258eaed10aa tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] HTTP exception thrown: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c40169ab-6ed7-445b-8e83-e258eaed10aa tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Request method failure captured: Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e HTTP/1.1 Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwG9cjqE7p3zKZdbYZsIb11t-ksQkjYu4-EHNyFtuK2yePJg8mtS_tzeNxp9DIteCNCdh-2FEsSZ1gNP_ld_gN3-EUsEvAqotvsBHgDAiUKKXpUqGHPDZkShxYsLyiGdZrus_vKyZcc4LkOd9SU_h4fwlydcMJ3ugtjo6SDfWPfOo Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:58.162783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}] Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 973b2f1bc42a48a7bc488889d5565944 Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'f5cdd1a7-75a2-469b-9a58-63a5ef49835e'} Oct 04 08:45:58.163877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. (HTTP 404) (Request-ID: req-2be4103c-1d58-4811-9939-edf4dc515cbe) Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.164551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:58.166198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:45:58.167099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.167991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.170767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c40169ab-6ed7-445b-8e83-e258eaed10aa tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Returning 404 to user: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:58.172106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c40169ab-6ed7-445b-8e83-e258eaed10aa tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 404 len: 109 microversion: 2.1 time: 0.082827 Oct 04 08:45:58.173210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 27/41] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:45:58 2022] GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:45:58.188616 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f6fa3af5-2022-4f6f-bb0c-5fdfe33f66f6 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd50aeee0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:58.251292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-f6fa3af5-2022-4f6f-bb0c-5fdfe33f66f6 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] HTTP exception thrown: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f6fa3af5-2022-4f6f-bb0c-5fdfe33f66f6 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Request method failure captured: Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e HTTP/1.1 Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwG9cjqE7p3zKZdbYZsIb11t-ksQkjYu4-EHNyFtuK2yePJg8mtS_tzeNxp9DIteCNCdh-2FEsSZ1gNP_ld_gN3-EUsEvAqotvsBHgDAiUKKXpUqGHPDZkShxYsLyiGdZrus_vKyZcc4LkOd9SU_h4fwlydcMJ3ugtjo6SDfWPfOo Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:58.254369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}] Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 973b2f1bc42a48a7bc488889d5565944 Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'f5cdd1a7-75a2-469b-9a58-63a5ef49835e'} Oct 04 08:45:58.255720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. (HTTP 404) (Request-ID: req-cb9857da-992d-410e-bc05-81b204cf9d58) Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.256492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:45:58.257735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:45:58.259909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.261009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.262101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f6fa3af5-2022-4f6f-bb0c-5fdfe33f66f6 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Returning 404 to user: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:58.263181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f6fa3af5-2022-4f6f-bb0c-5fdfe33f66f6 tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 404 len: 109 microversion: 2.1 time: 0.079756 Oct 04 08:45:58.263918 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 28/42] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:45:58 2022] DELETE /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:45:58.287782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ed108510-cc88-4288-a9c6-cdb61edf431c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Calling method '.version_select at 0x7f5fd4f3e040>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:58.409880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-ed108510-cc88-4288-a9c6-cdb61edf431c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] HTTP exception thrown: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ed108510-cc88-4288-a9c6-cdb61edf431c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Request method failure captured: Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e HTTP/1.1 Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_KwG9cjqE7p3zKZdbYZsIb11t-ksQkjYu4-EHNyFtuK2yePJg8mtS_tzeNxp9DIteCNCdh-2FEsSZ1gNP_ld_gN3-EUsEvAqotvsBHgDAiUKKXpUqGHPDZkShxYsLyiGdZrus_vKyZcc4LkOd9SU_h4fwlydcMJ3ugtjo6SDfWPfOo Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:45:58.421403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/281ccf5c1a784a89b9f4f5e0905f33ca"}]}] Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 281ccf5c1a784a89b9f4f5e0905f33ca Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1435989977 Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 973b2f1bc42a48a7bc488889d5565944 Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1435989977-project Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'f5cdd1a7-75a2-469b-9a58-63a5ef49835e'} Oct 04 08:45:58.423214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. (HTTP 404) (Request-ID: req-3d9be1c1-89f5-4628-98ee-eecc4f6ba3c7) Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.423976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:45:58.425103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:45:58.426402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ed108510-cc88-4288-a9c6-cdb61edf431c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] Returning 404 to user: Volume f5cdd1a7-75a2-469b-9a58-63a5ef49835e could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ed108510-cc88-4288-a9c6-cdb61edf431c tempest-VolumesSnapshotsTestJSON-1435989977 tempest-VolumesSnapshotsTestJSON-1435989977-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e" status: 404 len: 109 microversion: 2.1 time: 0.147643 Oct 04 08:45:58.427408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 29/43] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:45:58 2022] GET /compute/v2.1/os-volumes/f5cdd1a7-75a2-469b-9a58-63a5ef49835e => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:45:58.641774 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-161948652", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:58.833644 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] validate_networks() for [('23796c7f-d7b7-4b78-a709-9c1a747eda10', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:45:58.880286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1189566852", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88c58347-047b-4a5d-8961-d535f7933f4d"}], "security_groups": [{"name": "tempest-securitygroup--426196005"}], "key_name": "tempest-keypair-2130639977", "user_data": "}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:59.222850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] validate_networks() for [('88c58347-047b-4a5d-8961-d535f7933f4d', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:46:01.460506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:46:01.461843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:46:01.462507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:46:01.463079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:46:01.463702 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:46:01.496415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:01.496974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:01.497461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:01.501302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:01.501888 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:01.502344 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:01.601740 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for project ed8dda1234f54905962e427bf75e82c1. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:46:01.619821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for user ed4b7bfb87b144b38b82514c17a468bc and project ed8dda1234f54905962e427bf75e82c1. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:46:01.673352 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:46:01.683786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:46:01.903193 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-750c05f8-c82d-4478-b668-905233649d7a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.027967 Oct 04 08:46:01.905545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 30/44] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 4 08:45:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 3032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 08:46:01.913072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:01.925078 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:01.951419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:01.954778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:01.955656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:01.956508 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:01.959392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:01.965151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:02.291700 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:02.302174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4f998cd3-858b-4017-ac51-748953d83fdf tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.393151 Oct 04 08:46:02.302750 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 31/45] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:01 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:02.318388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-597c2ef0-45cf-4ca3-a38e-1be13b6c5191 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:02.319274 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-597c2ef0-45cf-4ca3-a38e-1be13b6c5191 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:02.354923 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:46:02.356191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:46:02.356892 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:46:02.357536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:46:02.358207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:46:02.382208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:02.383202 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:02.385435 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:02.389991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:02.390905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:02.394598 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:02.442044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-597c2ef0-45cf-4ca3-a38e-1be13b6c5191 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:02.457891 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-597c2ef0-45cf-4ca3-a38e-1be13b6c5191 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:02.470745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-597c2ef0-45cf-4ca3-a38e-1be13b6c5191 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:02.478470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-597c2ef0-45cf-4ca3-a38e-1be13b6c5191 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1282 microversion: 2.20 time: 0.170706 Oct 04 08:46:02.495480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for project 0b7703aae5634dabb496bc221882863c. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:46:02.495739 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 32/46] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:02 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:02.501915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for user acf57eb971eb4f78b173a5ab47160bd1 and project 0b7703aae5634dabb496bc221882863c. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:46:02.526747 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:46:02.530068 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:46:02.621512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c12b2e27-8ea7-4c96-9b6c-7b034a817fa5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.745715 Oct 04 08:46:02.622658 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 15/47] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:45:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:46:02.634473 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b1295be3-1fb5-472b-9a00-3a326b3aafb1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:02.635084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b1295be3-1fb5-472b-9a00-3a326b3aafb1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:02.662271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1368505628", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbaa5ae-9515-4efe-ae61-91971a7f125f"}], "security_groups": [{"name": "tempest-securitygroup--1870122907"}], "key_name": "tempest-keypair-814708181", "user_data": "}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:02.716045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b1295be3-1fb5-472b-9a00-3a326b3aafb1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:02.738538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b1295be3-1fb5-472b-9a00-3a326b3aafb1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1221 microversion: 2.1 time: 0.107850 Oct 04 08:46:02.741199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 33/48] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:02 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:02.989232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-126447611", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:11.561073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:12.300060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=20 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:12.455307 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=4 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:12.456281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=4 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:12.520225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=14 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:12.677486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:12.737055 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=20 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:13.009818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=5 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:14.222081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] validate_networks() for [('23796c7f-d7b7-4b78-a709-9c1a747eda10', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:46:14.303571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] validate_networks() for [('fbbaa5ae-9515-4efe-ae61-91971a7f125f', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:46:14.646847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:46:14.647405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:46:14.647962 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:46:14.648482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:46:14.648978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:46:14.658471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:14.659081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:14.659587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:14.660398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:14.661034 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:14.661673 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:14.688853 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for project 0b7703aae5634dabb496bc221882863c. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:46:14.693714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for user acf57eb971eb4f78b173a5ab47160bd1 and project 0b7703aae5634dabb496bc221882863c. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:46:14.705654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:46:14.708295 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:46:14.762076 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-686c7fa0-e62d-4985-8534-113dc3bf344f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 11.776872 Oct 04 08:46:14.763109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 34/49] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:46:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 11779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:46:14.768546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:14.769597 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:14.790782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:14.791461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:14.792051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:14.792920 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:14.793529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:14.794141 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:14.843040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:46:14.843562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:46:14.844095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:46:14.844508 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:46:14.844920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:46:14.860895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:14.861384 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:14.862079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:14.862850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:14.863512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:14.866531 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:14.887296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:46:14.892848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:46:14.906782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:46:14.910037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:46:14.953973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:14.969535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-173bfce3-b294-485c-81a8-338c789ff5be tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 12.313725 Oct 04 08:46:14.970506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-611136ea-5698-4723-a336-af82dfe64021 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.205876 Oct 04 08:46:14.971077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 35/50] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:14 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:14.973835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 16/51] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:46:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 12319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:46:14.975557 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:14.976156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:14.986771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-66677dee-13cc-4b7f-ac10-ec3f3c51b759 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:14.987508 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-66677dee-13cc-4b7f-ac10-ec3f3c51b759 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:15.010252 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:15.010800 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:15.011239 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:15.014844 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:15.015329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:15.015766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:15.044540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-66677dee-13cc-4b7f-ac10-ec3f3c51b759 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:15.054206 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-66677dee-13cc-4b7f-ac10-ec3f3c51b759 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1221 microversion: 2.1 time: 0.079112 Oct 04 08:46:15.054829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 17/52] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:14 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:15.082440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f32d1df2-73cd-4d79-9f1f-a48e0dd58298 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:15.083381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f32d1df2-73cd-4d79-9f1f-a48e0dd58298 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:15.126636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:15.148871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:15.152170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:15.153627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-051f2530-92b4-4cbe-be17-7af6e7972404 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1286 microversion: 2.20 time: 0.181608 Oct 04 08:46:15.165712 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 36/53] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:14 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:15.192122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f32d1df2-73cd-4d79-9f1f-a48e0dd58298 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:15.201748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f32d1df2-73cd-4d79-9f1f-a48e0dd58298 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1241 microversion: 2.1 time: 0.145710 Oct 04 08:46:15.202376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 18/54] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:15 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1241 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:16.001253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:16.001905 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:16.007798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.008223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.008657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.009378 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.009864 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.010290 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.078033 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:16.079998 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:16.090419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.102919 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.103507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.104718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.105201 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.105649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.157594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:16.167884 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-640d94ab-6e92-4cd2-8608-93f50a49a2d0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.170486 Oct 04 08:46:16.168568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 37/55] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:15 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:16.185849 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:16.186672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:16.197098 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.197875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.198623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.199533 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.200109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.200592 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.248124 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:16.260485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ba25ef3e-5b44-40ea-afe6-66be655bef34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1225 microversion: 2.1 time: 0.187494 Oct 04 08:46:16.261144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 19/56] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:16 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1225 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:16.265884 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:16.266837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:16.268706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:16.275437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.276007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.276517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.277287 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:16.277929 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:16.278503 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:16.283643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:16.285627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:16.286948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4cefb703-4c37-413b-b2b5-23949079163b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1286 microversion: 2.20 time: 0.108516 Oct 04 08:46:16.287497 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 38/57] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:16 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:16.364148 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:16.371969 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8df35929-aedf-4889-9b41-bbf41bb2e684 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1245 microversion: 2.1 time: 0.109636 Oct 04 08:46:16.372540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 20/58] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:16 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:17.191798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:17.192411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:17.198753 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.199226 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.199654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.200362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.200812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.201225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.284483 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:17.285385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:17.291797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.292272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.302368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.302368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.302368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.302368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.337710 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:17.346807 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f4751d97-f6f4-48d4-bf1c-2b73e3cc8d24 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.159050 Oct 04 08:46:17.347735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 39/59] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:17 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:17.353509 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:17.354130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:17.362622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.363101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.363529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.364206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.364841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.365309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.369920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:17.377563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-62f4896a-c12e-4733-b948-38a908fc9ec7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1225 microversion: 2.1 time: 0.098004 Oct 04 08:46:17.378213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 21/60] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:17 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:17.395243 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:17.396225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:17.403044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.406391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.406847 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.407564 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:17.408021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:17.408860 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:17.442701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:17.452361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:17.454422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:17.455881 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-68de0a43-500f-49c6-a61f-d38ab9b924ae tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1286 microversion: 2.20 time: 0.107221 Oct 04 08:46:17.456627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 40/61] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:17 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:17.500141 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:17.507767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bbaedae6-d7a3-41af-bd28-456c43614130 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1245 microversion: 2.1 time: 0.116790 Oct 04 08:46:17.508328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 22/62] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:17 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:18.374895 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:18.376084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:18.387434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.388460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.389435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.390789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.391996 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.392835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.401519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:18.402314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:18.416374 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.416820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.418291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.419262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.420358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.422823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.525987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:18.536499 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-aba17342-6bb9-467b-b6bb-0c6be5395712 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1273 microversion: 2.1 time: 0.138978 Oct 04 08:46:18.537090 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 23/63] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:18 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:18.564766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:18.564766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:18.564766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.565447 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.569806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.569806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.569806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.569806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.656751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:18.685656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:18.688012 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:18.689164 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6e60f28d-1792-4aec-a03d-1efb6642f833 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1278 microversion: 2.20 time: 0.151009 Oct 04 08:46:18.692340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 24/64] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:18 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:18.701642 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:18.701907 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:18.706439 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:18.722290 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a4ef85ea-fff5-4e6d-a5fb-6c77378add02 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.355080 Oct 04 08:46:18.723079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 41/65] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:18 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:18.731216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.741258 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.744973 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.746636 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:18.747587 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:18.748559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:18.871706 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:18.882001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2cad9f1c-6ab2-4dbd-a4bd-1cc050e4e67c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1237 microversion: 2.1 time: 0.188259 Oct 04 08:46:18.883405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 25/66] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:18 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1237 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:19.475020 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-d4daa0c1-1fe6-4fea-89d5-31b4fc8bb3f8 req-4a2961b9-cbb4-407d-8ae5-a1cd64927e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb90b4ee-26be-43ad-93c1-458a94c15bd2", "tag": "cc4bf9bf-a7c3-43e2-bb42-849e6af4f9de"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:19.489779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d4daa0c1-1fe6-4fea-89d5-31b4fc8bb3f8 req-4a2961b9-cbb4-407d-8ae5-a1cd64927e9a service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.490270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d4daa0c1-1fe6-4fea-89d5-31b4fc8bb3f8 req-4a2961b9-cbb4-407d-8ae5-a1cd64927e9a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.491348 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d4daa0c1-1fe6-4fea-89d5-31b4fc8bb3f8 req-4a2961b9-cbb4-407d-8ae5-a1cd64927e9a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.513737 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-d4daa0c1-1fe6-4fea-89d5-31b4fc8bb3f8 req-4a2961b9-cbb4-407d-8ae5-a1cd64927e9a service nova] Creating event network-changed:cc4bf9bf-a7c3-43e2-bb42-849e6af4f9de for instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 on hv-cinder-86021 Oct 04 08:46:19.514437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d4daa0c1-1fe6-4fea-89d5-31b4fc8bb3f8 req-4a2961b9-cbb4-407d-8ae5-a1cd64927e9a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 08:46:19.514972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d4daa0c1-1fe6-4fea-89d5-31b4fc8bb3f8 req-4a2961b9-cbb4-407d-8ae5-a1cd64927e9a service nova] Acquired lock "compute-rpcapi-router" {{(pid=126938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 08:46:19.516149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.516776 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.517347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.518226 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.518940 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.519501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.529553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.compute.rpcapi [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 08:46:19.530659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] Releasing lock "compute-rpcapi-router" {{(pid=126938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 08:46:19.546880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1e364793-cecc-40e6-9d0d-f4735239c0e1 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142233 Oct 04 08:46:19.547838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 42/67] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:19.584924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:19.586988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:19.597505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.598776 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.599758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.600987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.602304 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.603054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.681508 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:19.701571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-54af019e-d19e-414e-89e1-48fcd1274ddc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1279 microversion: 2.1 time: 0.118444 Oct 04 08:46:19.701829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 26/68] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:19 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:19.726212 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:19.727266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:19.741472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.751796 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:19.754569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:19.755664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.756624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.759869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.760403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.760840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.767981 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.769982 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.770649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.771899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.772635 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.773900 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.910697 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:19.931005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:19.932487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:19.933605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7101c9e3-ef55-46a5-9ebc-f620bcc5acb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1342 microversion: 2.20 time: 0.214780 Oct 04 08:46:19.956706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 43/69] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:19 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:19.967954 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:19.968818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:19.983683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.988419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.989123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:19.990304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:19.997925 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:19.998611 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:20.499690 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:20.514301 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-bb518696-5ee2-42ee-bc26-9bcf3072baa2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1293 microversion: 2.1 time: 0.555881 Oct 04 08:46:20.515428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 44/70] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:19 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1293 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:20.682902 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:20.698168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a54f4e4d-75e6-4f3f-ba66-96d3875b92a0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.951463 Oct 04 08:46:20.699432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 27/71] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:19 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:20.743683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:20.744640 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:20.770357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:20.770357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:20.771885 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:20.775644 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:20.776866 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:20.777316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:20.962925 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:20.963871 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:20.979528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:20.981823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:20.983804 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:20.985001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:20.986345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:20.987945 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:21.143976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:21.165512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:21.168642 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:21.172032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-986dfda2-5853-40d3-a5bb-b0207aee58f3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1340 microversion: 2.20 time: 0.212321 Oct 04 08:46:21.173333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 28/72] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:20 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:21.322343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:21.332332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-703c3285-f05c-4371-a19b-fd62d30ef04a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.607117 Oct 04 08:46:21.332816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 45/73] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:20 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:21.549424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:21.552413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:21.565799 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:21.566875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:21.568034 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:21.569268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:21.570698 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:21.571727 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:21.681888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:21.696864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-714b7b32-e7e7-439b-b911-d0b1545646af tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1299 microversion: 2.1 time: 0.157250 Oct 04 08:46:21.699409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 29/74] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:21 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:21.738113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:21.739894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:21.748330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:21.749050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:21.749677 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:21.750553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:21.751247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:21.751806 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:21.970973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:21.980349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-47144699-76b0-4229-b9ab-932e09d088e5 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.248600 Oct 04 08:46:21.994501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 46/75] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:21 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:22.199632 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:22.200234 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:22.207329 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:22.208962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:22.209861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:22.210627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:22.211713 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:22.212290 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:22.262303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-6e9786a0-4470-4ac5-9209-5fcce1e5ec2d req-1e8abc77-4e9a-4235-9f5e-fcfc189d0f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba00a4bd-7048-40e3-8959-08035cc5d3f4", "tag": "dccd562a-a7a1-4225-9d91-75e4cd339aff"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:22.277093 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-6e9786a0-4470-4ac5-9209-5fcce1e5ec2d req-1e8abc77-4e9a-4235-9f5e-fcfc189d0f2d service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:22.277771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-6e9786a0-4470-4ac5-9209-5fcce1e5ec2d req-1e8abc77-4e9a-4235-9f5e-fcfc189d0f2d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:22.278297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-6e9786a0-4470-4ac5-9209-5fcce1e5ec2d req-1e8abc77-4e9a-4235-9f5e-fcfc189d0f2d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:22.290636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-6e9786a0-4470-4ac5-9209-5fcce1e5ec2d req-1e8abc77-4e9a-4235-9f5e-fcfc189d0f2d service nova] Creating event network-changed:dccd562a-a7a1-4225-9d91-75e4cd339aff for instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 on hv-cinder-86021 Oct 04 08:46:22.295847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-6e9786a0-4470-4ac5-9209-5fcce1e5ec2d req-1e8abc77-4e9a-4235-9f5e-fcfc189d0f2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099729 Oct 04 08:46:22.296900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 47/76] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:22.356014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:22.356911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:22.363752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:22.364535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:22.365122 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:22.365848 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:22.366303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:22.366720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:22.374644 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:22.383239 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:22.384861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:22.386284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-927eb6ef-64ff-434d-a53f-d65cadc9683d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.190461 Oct 04 08:46:22.387026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 30/77] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:22 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:22.514540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:22.523962 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9816db93-d7cf-4c95-acd1-500277ba0d5f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.172360 Oct 04 08:46:22.524520 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 48/78] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:22 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:22.724047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:22.724047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:22.728349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:22.728835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:22.729270 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:22.730166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:22.730627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:22.731050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:22.793747 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:22.801566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fb621b98-7e2d-444a-8860-81633450d5de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1299 microversion: 2.1 time: 0.083767 Oct 04 08:46:22.802156 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 31/79] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:22 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:23.004472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:23.005083 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:23.011455 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.011929 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.012514 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.013201 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.013643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.014085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.151454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:23.159099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-73c4fd2b-b5d9-4513-9d72-f497fbccc18e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.158499 Oct 04 08:46:23.159654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 49/80] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:22 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:23.412374 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:23.413151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:23.419612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.420098 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.420519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.421204 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.421718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.422829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.547570 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:23.548538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:23.555546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.556179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.556710 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.557528 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.558110 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.558635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.569489 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:23.598236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:23.600931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:23.603262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b78c9023-3ccd-4b11-8c15-e916f9e8f8ea tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.194774 Oct 04 08:46:23.604510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 32/81] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:23 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:23.720927 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:23.734082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-65479115-7ac7-44be-b7a6-d5f711d04134 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.190192 Oct 04 08:46:23.734958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 50/82] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:23 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:23.825570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:23.826207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:23.832017 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.832524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.832951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.833789 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:23.834097 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:23.834516 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:23.898325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:23.906088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-403fbce5-ad72-4fbc-865a-9b830442d9f5 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1299 microversion: 2.1 time: 0.084500 Oct 04 08:46:23.906747 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 33/83] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:23 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:24.183388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:24.184001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:24.189820 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.190305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.190798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.191491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.191944 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.192365 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.373380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:24.383711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6ea73545-2c73-45aa-a17a-be43224ba351 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.204957 Oct 04 08:46:24.384296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 51/84] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:24 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:24.628829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:24.629474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:24.636182 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.636668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.637122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.637855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.638311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.638732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.757105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:24.760097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:24.765904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:24.767364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.767851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.768292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.769001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.769453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.770202 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.787232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:24.816288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:24.825064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:24.826991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:24.828816 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3db44604-9ae0-4b95-93dd-65d97d408c82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.203984 Oct 04 08:46:24.829978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 34/85] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:24 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:24.926121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:24.926279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:24.930653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:24.931224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:24.939398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.939882 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.940312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.941014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:24.944194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:24.945216 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6054c33c-a1e7-44c5-93c0-accf5edb4447 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.192711 Oct 04 08:46:24.946169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 52/86] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:24 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:24.948373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:24.968003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:25.016559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:25.025050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8d274abe-e6ea-46c9-84de-b3f9bac6092b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1299 microversion: 2.1 time: 0.099633 Oct 04 08:46:25.025614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 35/87] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:24 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:25.426803 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:25.427906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:25.454080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:25.454942 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:25.455707 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:25.456923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:25.457976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:25.459303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:25.677252 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:25.686464 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-42a4ad39-1c33-456e-9dc0-63cdabb1c932 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.282561 Oct 04 08:46:25.687247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 53/88] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:25 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:25.858090 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:25.859042 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:25.863465 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=10 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:25.867172 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:25.867838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:25.868276 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:25.869009 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:25.869460 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:25.869947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:25.968905 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:25.970612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:25.980152 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:25.980743 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:25.981288 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:25.982248 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:25.982802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:25.983445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.136504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:26.144624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:26.146147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:26.147536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-081cc808-6f73-4f39-87d7-549dcc6ad4ee tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.293445 Oct 04 08:46:26.150502 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:26.159585 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7fa78ca5-d2ac-4020-8717-f7fe81f94ed8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.195344 Oct 04 08:46:26.160324 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 54/89] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:25 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:26.164794 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 36/90] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:25 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:26.168418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:26.169083 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:26.176592 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:26.177400 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:26.178019 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.178705 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:26.179982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:26.180543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.255232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:26.266698 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-45e42277-2bab-4361-8f6e-0b3b76f05d22 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1299 microversion: 2.1 time: 0.104915 Oct 04 08:46:26.267484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 55/91] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:26 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:26.487446 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-ee96e738-76e1-4f0d-a777-4b80ae5db4cf req-976cc88c-3e8b-4c55-92b5-0275aa91ab92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c490e2-0104-4fcb-b255-1f1c8b41c083", "tag": "3cedc437-d079-40c2-a255-95cbfb8ae43c"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:26.500372 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ee96e738-76e1-4f0d-a777-4b80ae5db4cf req-976cc88c-3e8b-4c55-92b5-0275aa91ab92 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:26.500909 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ee96e738-76e1-4f0d-a777-4b80ae5db4cf req-976cc88c-3e8b-4c55-92b5-0275aa91ab92 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:26.501559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ee96e738-76e1-4f0d-a777-4b80ae5db4cf req-976cc88c-3e8b-4c55-92b5-0275aa91ab92 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.521179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-ee96e738-76e1-4f0d-a777-4b80ae5db4cf req-976cc88c-3e8b-4c55-92b5-0275aa91ab92 service nova] Creating event network-changed:3cedc437-d079-40c2-a255-95cbfb8ae43c for instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 on hv-cinder-86021 Oct 04 08:46:26.522060 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ee96e738-76e1-4f0d-a777-4b80ae5db4cf req-976cc88c-3e8b-4c55-92b5-0275aa91ab92 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 08:46:26.522449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ee96e738-76e1-4f0d-a777-4b80ae5db4cf req-976cc88c-3e8b-4c55-92b5-0275aa91ab92 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 08:46:26.524049 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:26.524502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:26.524921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.525618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:26.526234 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:26.526653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.535784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.compute.rpcapi [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 08:46:26.536668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=126939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 08:46:26.551228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c2879de3-87c9-44c5-81d8-fdde2d5813a8 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067665 Oct 04 08:46:26.553958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 37/92] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:46:26.714139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:26.714891 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:26.722337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:26.722814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:26.723414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.724107 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:26.724555 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:26.724971 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:26.871384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:26.879442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2ecd27d9-15fc-41d1-bb40-016e41898be7 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.172310 Oct 04 08:46:26.880254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 56/93] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:26 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:27.173179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:27.173907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:27.181502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.182172 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.182765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:27.183479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:27.183803 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.184295 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:27.184557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.185125 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:27.192372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.193233 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.193830 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:27.196461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.197050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.198521 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:27.375578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:27.386257 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-77bfdda0-856a-44fb-a924-e941edb9eab8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.207262 Oct 04 08:46:27.387363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 57/94] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:27 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:27.388197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:27.391958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:27.393369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:27.399766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:27.402510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.402627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:27.402724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.402724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:27.403086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.403701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.404277 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:27.408035 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bdc51f3c-1a28-4d25-bde1-36b40ba16e38 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.233661 Oct 04 08:46:27.408637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 38/95] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:27 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:27.475296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:27.483061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ec93bbdb-a19d-4ef9-8c33-4eefee04c83a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1299 microversion: 2.1 time: 0.094666 Oct 04 08:46:27.483621 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 58/96] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:27 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:27.903291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:27.904347 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:27.910352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.910875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.911382 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:27.912080 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:27.912544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:27.913023 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:28.052317 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:28.060298 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9b33a515-c235-4083-b159-b6b0e2676599 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.160897 Oct 04 08:46:28.060854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 39/97] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:27 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:28.412520 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:28.413132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:28.419803 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:28.420211 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:28.420638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:28.421317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:28.421786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:28.422204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:28.438664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:28.439265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:28.445480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:28.446144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:28.446721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:28.447568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:28.448011 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:28.448585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:28.688556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:28.703935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1ee2ff1c-ddbf-4002-93d2-f15dda67aa51 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.293383 Oct 04 08:46:28.705958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 59/98] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:28 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:28.714331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:28.714778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:28.715442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:28.725947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:28.726681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:28.727056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:28.729946 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:28.731009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:28.731796 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:28.732031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:28.732757 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:28.733231 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-37d5d6b5-bfbc-4fa8-b778-527012316118 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.298246 Oct 04 08:46:28.738904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 40/99] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:28 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:46:28.864339 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:28.874087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c3479edf-a376-42d1-9173-27510203b4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1299 microversion: 2.1 time: 0.164701 Oct 04 08:46:28.874675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 60/100] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:28 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:29.083505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:29.084215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:29.094049 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:29.094680 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:29.095555 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:29.096349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:29.097044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:29.097679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:29.501128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:29.522646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e22e9e18-50f7-4e99-b6f7-6d7e41e02d6f tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.443142 Oct 04 08:46:29.524016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 41/101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:29 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:29.735073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:29.736637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:29.747377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=4 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:29.752814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:29.753914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:29.754766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:29.756027 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:29.756762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:29.757988 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:29.782813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:29.785438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:29.812996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:29.814295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:29.817561 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:29.819163 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:29.823236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:29.824034 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:30.256346 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:30.264835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:30.267451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:30.268586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0901e70b-dc01-431e-9c34-639e07af632f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.504401 Oct 04 08:46:30.281814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 42/102] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:29 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:30.281814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:30.281814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:30.282311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:30.282611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:30.283273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:30.284294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:30.284932 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:30.285533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:30.369229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:30.379262 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b5b41da6-fe2c-4fd9-aa39-8a9d5e696141 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.653625 Oct 04 08:46:30.380380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 61/103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:29 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:30.555170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:30.555894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:30.563586 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:30.564151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:30.565041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:30.565788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:30.566251 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:30.566684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:30.737246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:30.748278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c2d6d126-7d2d-42c5-96b9-40818af6a875 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.477056 Oct 04 08:46:30.749213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 43/104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:30 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:31.204134 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:31.214964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4e171e9f-69ef-406f-887c-d59ac4a3ad3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.668459 Oct 04 08:46:31.216208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 62/105] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:30 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:31.301198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:31.302245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:31.314559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:31.316303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:31.317096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:31.318010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:31.318778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:31.321567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:31.404545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:31.405475 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:31.424477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:31.426924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:31.427851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:31.433149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:31.434278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:31.436451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:31.561248 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:31.587493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:31.589600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:31.590962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-96e4a6e4-1540-40f0-96b3-0587551c85de tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.293757 Oct 04 08:46:31.592338 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 44/106] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:31 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:31.774026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:31.774981 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:31.789835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:31.790416 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:31.790922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:31.791695 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:31.792215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:31.792718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:31.927874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:31.939573 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9e41df8a-2b8e-4eaa-8bf8-aeaaa5ccdf75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.539646 Oct 04 08:46:31.940823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 63/107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:31 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:32.008819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:32.023619 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-45500cea-9512-4370-a967-4aee9fb4beca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.253651 Oct 04 08:46:32.039294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 45/108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:31 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:32.247106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:32.248126 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:32.267429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.268479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.268977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:32.269945 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.270548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.271215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:32.416047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-a655a57e-e461-47dc-850e-26039af96da8 req-ec34c857-943a-49df-8c56-b8fb86de5bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b03cac8-950a-405e-b19b-90a962f5c73f", "tag": "615440bd-a86a-4725-9efe-5cc93f1f22d9"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:32.436112 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-a655a57e-e461-47dc-850e-26039af96da8 req-ec34c857-943a-49df-8c56-b8fb86de5bee service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.437119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-a655a57e-e461-47dc-850e-26039af96da8 req-ec34c857-943a-49df-8c56-b8fb86de5bee service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.439008 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-a655a57e-e461-47dc-850e-26039af96da8 req-ec34c857-943a-49df-8c56-b8fb86de5bee service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:32.473959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-a655a57e-e461-47dc-850e-26039af96da8 req-ec34c857-943a-49df-8c56-b8fb86de5bee service nova] Creating event network-changed:615440bd-a86a-4725-9efe-5cc93f1f22d9 for instance 7b03cac8-950a-405e-b19b-90a962f5c73f on hv-cinder-86021 Oct 04 08:46:32.479230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-a655a57e-e461-47dc-850e-26039af96da8 req-ec34c857-943a-49df-8c56-b8fb86de5bee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069016 Oct 04 08:46:32.480550 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 46/109] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:46:32.535190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:32.544654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c9cf3da2-a16c-474b-a655-6ba9751a63a2 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.309862 Oct 04 08:46:32.562961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 64/110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:32 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:32.609522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-3ad788d0-6c01-4aef-93dc-0f00b2d9b2b5 req-11062167-9746-48f3-89f0-36be687901c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb90b4ee-26be-43ad-93c1-458a94c15bd2", "name": "network-vif-plugged", "status": "completed", "tag": "cc4bf9bf-a7c3-43e2-bb42-849e6af4f9de"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:32.619303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-3ad788d0-6c01-4aef-93dc-0f00b2d9b2b5 req-11062167-9746-48f3-89f0-36be687901c4 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.619981 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-3ad788d0-6c01-4aef-93dc-0f00b2d9b2b5 req-11062167-9746-48f3-89f0-36be687901c4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.620678 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-3ad788d0-6c01-4aef-93dc-0f00b2d9b2b5 req-11062167-9746-48f3-89f0-36be687901c4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:32.621164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:32.621862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:32.629373 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.630037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.630637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:32.631665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.632932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.633730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:32.635936 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-3ad788d0-6c01-4aef-93dc-0f00b2d9b2b5 req-11062167-9746-48f3-89f0-36be687901c4 service nova] Creating event network-vif-plugged:cc4bf9bf-a7c3-43e2-bb42-849e6af4f9de for instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 on hv-cinder-86021 Oct 04 08:46:32.642124 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-3ad788d0-6c01-4aef-93dc-0f00b2d9b2b5 req-11062167-9746-48f3-89f0-36be687901c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133455 Oct 04 08:46:32.648220 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 47/111] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:32.805212 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:32.816976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:32.818693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:32.820450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4eeb6ef5-93fe-4667-b0a0-b0aef19b46c3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.202494 Oct 04 08:46:32.820996 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 65/112] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:32 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:46:32.964162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:32.964883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:32.972580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.972580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.972931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:32.973620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:32.974248 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:32.974976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:33.046802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:33.047405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:33.059035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:33.059537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:33.059976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:33.060664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:33.061283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:33.061675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:33.175329 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:33.187544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-750d9240-45d9-4199-a7e1-e26f8e1da1d0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.227560 Oct 04 08:46:33.188284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 48/113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:32 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:33.241272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:33.250199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2f472110-a145-46a0-9834-2e0c708e2409 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.207155 Oct 04 08:46:33.250784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 66/114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:33.570637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:33.571918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:33.580149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:33.580883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:33.581785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:33.582681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:33.583490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:33.584229 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:33.847273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:33.850006 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:33.852577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:33.860679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f2e29812-f258-46f1-82d8-201b3f6ad11a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.294494 Oct 04 08:46:33.863811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:33.866787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:33.866976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 49/115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:33.867551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:33.869454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:33.872505 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:33.873042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:34.128119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:34.138619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:34.140763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:34.142451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-40d0fec9-9779-428a-a7dd-65187273abcf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.300733 Oct 04 08:46:34.144046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 67/116] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:33 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:46:34.211550 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:34.212103 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:34.221629 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:34.222159 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:34.222596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:34.230825 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:34.231364 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:34.231772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:34.274623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:34.275894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:34.289497 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:34.290244 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:34.294082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:34.297846 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:34.298488 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:34.300424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:34.472469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:34.483784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-10f265ad-f6df-4222-9453-b08ad2639b65 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.277155 Oct 04 08:46:34.485021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 50/117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:34 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:34.604286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:34.611942 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:34.619874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e2617f7f-9cad-46bf-bd1b-6858dea17405 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.350394 Oct 04 08:46:34.622354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 68/118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:34 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:34.731049 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-da885891-e6b7-4966-a53a-d63c681cf9ca req-f901fe02-51aa-475e-aab5-75b209c4f81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab02709a-3a90-4a5c-a268-deb0ab3e95c8", "tag": "0ccb9534-559a-4485-9935-ec9f4f50c53e"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:34.743358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-da885891-e6b7-4966-a53a-d63c681cf9ca req-f901fe02-51aa-475e-aab5-75b209c4f81f service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:34.744132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-da885891-e6b7-4966-a53a-d63c681cf9ca req-f901fe02-51aa-475e-aab5-75b209c4f81f service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:34.744747 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-da885891-e6b7-4966-a53a-d63c681cf9ca req-f901fe02-51aa-475e-aab5-75b209c4f81f service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:34.756761 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-da885891-e6b7-4966-a53a-d63c681cf9ca req-f901fe02-51aa-475e-aab5-75b209c4f81f service nova] Creating event network-changed:0ccb9534-559a-4485-9935-ec9f4f50c53e for instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 on hv-cinder-86021 Oct 04 08:46:34.771402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-da885891-e6b7-4966-a53a-d63c681cf9ca req-f901fe02-51aa-475e-aab5-75b209c4f81f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045875 Oct 04 08:46:34.772022 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 51/119] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:34.883706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:34.884518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:34.892324 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:34.893016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:34.893453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:34.894407 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:34.894901 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:34.895587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:35.060590 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:35.069494 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-606aa787-49b6-42e0-a379-4ca2909c64db tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.189795 Oct 04 08:46:35.070088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 69/120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:34 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:35.173220 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:35.174171 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:35.181521 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:35.182268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:35.182787 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:35.183541 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:35.184265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:35.184918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:35.355500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:35.363726 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:35.365161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:35.366836 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e6a78aa3-83d6-46b3-9a1d-2d9847d89168 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.199368 Oct 04 08:46:35.367461 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 52/121] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:35 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:35.511005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:35.512230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:35.523608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:35.524103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:35.524657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:35.525328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:35.526001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:35.526791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:35.644466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:35.645198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:35.652005 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:35.652600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:35.653094 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:35.654020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:35.654741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:35.655157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:35.768151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:35.780580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-298047b7-a8d7-450b-930a-0292dfe8abd3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.276463 Oct 04 08:46:35.782270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 70/122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:35 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:35.823071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:35.832294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-49a768f2-d5f7-401a-bfc3-e16e8e14429d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.190835 Oct 04 08:46:35.832865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 53/123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:35 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:36.096053 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:36.096903 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:36.108046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.109126 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.109776 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:36.110826 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.111830 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.112710 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:36.300833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:36.315000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-767c15bb-2d6d-4b81-96eb-ecdc61c51aa0 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.220448 Oct 04 08:46:36.315743 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 71/124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:36 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:36.392535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:36.393157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:36.410061 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.410597 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.416842 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:36.417596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.418099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.418532 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:36.424023 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:36.533870 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:36.805442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:36.806175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:36.814964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.816044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.819163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:36.820714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.821465 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.822144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:36.829810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:36.838763 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:36.840224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:36.841405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b59e5453-5223-4353-acde-106d431f134b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.452686 Oct 04 08:46:36.864403 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 54/125] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:36 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:36.884071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:36.887110 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:36.902620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.903104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.904758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:36.905473 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:36.908519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:36.908951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:37.062904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:37.074197 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fafc941f-a5e1-40e8-b236-d879988df70b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.273359 Oct 04 08:46:37.078096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 72/126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:36 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:37.129526 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:37.153730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-eabe19ae-2435-4a37-a8a9-6ae972384563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.282507 Oct 04 08:46:37.154337 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 55/127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:36 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:37.339647 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:37.340474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:37.349106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:37.349598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:37.350116 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:37.351210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:37.351657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:37.352218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:37.524552 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:37.535336 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7d60b7d9-503c-41d4-a72a-e140f9d40253 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.199323 Oct 04 08:46:37.535863 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 73/128] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:37 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:37.883471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:37.884084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:37.887162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:37.891346 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:37.891835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:37.892258 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:37.893153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:37.893592 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:37.894029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.091231 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:38.097591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:38.098318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:38.106191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:38.108166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:38.111058 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-daf5edb9-f91a-4dda-a82c-8f251ca1a214 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.231878 Oct 04 08:46:38.112550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:38.113045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:38.113479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.114035 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 56/129] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:37 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:38.114205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:38.123777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:38.131578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.178322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:38.179524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:38.195329 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:38.201590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:38.202252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.205249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:38.207828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:38.210453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.547447 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:38.559420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f29513a5-b7db-436c-a081-6e2303c13734 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.385858 Oct 04 08:46:38.561097 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 57/130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:38 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:38.590337 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:38.590956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:38.599813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:38.610378 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a149c1fa-5124-4835-bfd6-50da3044f4a7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.517593 Oct 04 08:46:38.613558 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:38.614076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:38.614501 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.617847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 74/131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:38 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:38.618822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:38.620741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:38.621327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.773764 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-dcf9a54b-dcd5-46c6-b3d7-70318596f758 req-497d778a-6dcf-4c7d-b7dd-841eeb9d44c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba00a4bd-7048-40e3-8959-08035cc5d3f4", "name": "network-vif-plugged", "status": "completed", "tag": "dccd562a-a7a1-4225-9d91-75e4cd339aff"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:38.803840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-dcf9a54b-dcd5-46c6-b3d7-70318596f758 req-497d778a-6dcf-4c7d-b7dd-841eeb9d44c8 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:38.804860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-dcf9a54b-dcd5-46c6-b3d7-70318596f758 req-497d778a-6dcf-4c7d-b7dd-841eeb9d44c8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:38.805452 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-dcf9a54b-dcd5-46c6-b3d7-70318596f758 req-497d778a-6dcf-4c7d-b7dd-841eeb9d44c8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:38.841923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-dcf9a54b-dcd5-46c6-b3d7-70318596f758 req-497d778a-6dcf-4c7d-b7dd-841eeb9d44c8 service nova] Creating event network-vif-plugged:dccd562a-a7a1-4225-9d91-75e4cd339aff for instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 on hv-cinder-86021 Oct 04 08:46:38.856113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-dcf9a54b-dcd5-46c6-b3d7-70318596f758 req-497d778a-6dcf-4c7d-b7dd-841eeb9d44c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087354 Oct 04 08:46:38.857872 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 75/132] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:38.905899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:38.916209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-35f234e1-0cbc-4a92-aa65-339d63b07595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1315 microversion: 2.1 time: 0.354006 Oct 04 08:46:38.916794 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 58/133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:38 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:39.139331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:39.140021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:39.147783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.150899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.151633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:39.152476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.153106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.153815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:39.331070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:39.343109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:39.346777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:39.348906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2595951e-78b4-4660-ab7c-f0785dedfeed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.213801 Oct 04 08:46:39.351132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 76/134] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:39 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:46:39.583125 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:39.583923 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:39.601910 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.602405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.603041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:39.603972 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.604357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.606293 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:39.637788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:39.638881 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:39.667485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:39.670579 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.671090 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.711047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:39.713305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.714165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.715591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:39.827211 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:39.836538 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-336698ae-f409-43b1-b557-6de490a634ae tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.257172 Oct 04 08:46:39.838804 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 59/135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:39 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:39.911591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:39.923723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2b7a8e56-042b-471f-8d25-061fba74c89e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.290585 Oct 04 08:46:39.924468 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 77/136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:39 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:39.943124 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:39.943739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:39.949824 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.950315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.950771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:39.951437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:39.951889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:39.952344 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:40.092006 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:40.102199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-264485e7-cb7b-4ddf-8857-6a6cb72d7945 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1502 microversion: 2.1 time: 0.163181 Oct 04 08:46:40.102801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 60/137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:39 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:40.378838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:40.379604 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:40.386827 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:40.387372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:40.387876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:40.399209 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:40.399762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:40.400210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:40.567788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:40.576026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:40.577461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:40.578577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-71390f7a-2940-4dfb-9bd8-7fa8e3561c60 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.203994 Oct 04 08:46:40.579149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 78/138] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:40 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:40.860490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:40.861742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:40.867328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:40.867805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:40.868395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:40.869086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:40.869534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:40.869977 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:40.948585 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:40.949607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:40.957768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:40.958432 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:40.959148 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:40.960903 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:40.961577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:40.962172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:41.038271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:41.046942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7329041f-c590-42e4-a905-efa9dc9eef39 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.190260 Oct 04 08:46:41.047950 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 61/139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:40 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:41.059178 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-c049f261-330d-4942-82a3-70187cab414e req-0e708f3b-6b70-4102-ac64-ae05d616175d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c490e2-0104-4fcb-b255-1f1c8b41c083", "name": "network-vif-plugged", "status": "completed", "tag": "3cedc437-d079-40c2-a255-95cbfb8ae43c"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:41.071467 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c049f261-330d-4942-82a3-70187cab414e req-0e708f3b-6b70-4102-ac64-ae05d616175d service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:41.071953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c049f261-330d-4942-82a3-70187cab414e req-0e708f3b-6b70-4102-ac64-ae05d616175d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:41.072380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c049f261-330d-4942-82a3-70187cab414e req-0e708f3b-6b70-4102-ac64-ae05d616175d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:41.086682 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-c049f261-330d-4942-82a3-70187cab414e req-0e708f3b-6b70-4102-ac64-ae05d616175d service nova] Creating event network-vif-plugged:3cedc437-d079-40c2-a255-95cbfb8ae43c for instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 on hv-cinder-86021 Oct 04 08:46:41.091789 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-c049f261-330d-4942-82a3-70187cab414e req-0e708f3b-6b70-4102-ac64-ae05d616175d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036272 Oct 04 08:46:41.092449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 62/140] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:46:41.141272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:41.149976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9a5e2148-efa6-470d-83cd-b5ddefb26d3c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.206542 Oct 04 08:46:41.150641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 79/141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:40 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:41.502302 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bb0f448-124b-45b8-a971-2befbe303ccd"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:41.504715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:41.511077 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:41.511560 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:41.511985 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:41.512672 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:41.513125 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:41.513547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:41.610948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:41.611651 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:41.618335 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:41.618893 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:41.619340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:41.620030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:41.620478 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:41.620907 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:41.750723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:41.758708 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:41.760156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:41.761266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8d942305-33b5-466c-9995-89a1f1965142 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.154355 Oct 04 08:46:41.761846 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 80/142] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:41 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:42.071647 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:42.072295 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:42.078306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:42.078778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:42.079219 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:42.079900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:42.080395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:42.080775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:42.218683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:42.226553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e5ac8381-cfe0-4e4a-a30d-eb84da761c66 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.158776 Oct 04 08:46:42.227541 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 81/143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:42 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:42.232316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:42.233084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:42.238900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:42.239379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:42.239810 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:42.240500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:42.240948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:42.241367 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:42.375027 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:42.383555 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ab703a90-6236-47fb-9c89-7193a94c7965 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.155015 Oct 04 08:46:42.384123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 82/144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:42 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:42.789101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:42.790042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:42.798504 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:42.799769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:42.800399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:42.801344 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:42.810596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:42.811330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:43.006696 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:43.016051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:43.017653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:43.018814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-09d5fab2-5435-429a-82bd-28e00060fe82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.235972 Oct 04 08:46:43.019587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 83/145] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:42 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:43.249632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:43.250260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:43.256158 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:43.262612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:43.263184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:43.263816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:43.264431 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:43.265002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:43.399707 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:43.408125 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-df5abc99-e3f9-4bcf-b6df-02db0659e81d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.162219 Oct 04 08:46:43.408789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 84/146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:43 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:43.413534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:43.414237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:43.420201 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:43.420900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:43.421505 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:43.422404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:43.422853 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:43.423268 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:43.599674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:43.607363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0b22b774-7169-440f-bc41-c74a2a537a30 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.197618 Oct 04 08:46:43.607949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 85/147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:43 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:44.045386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:44.046068 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:44.052464 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:44.052947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:44.053925 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:44.054614 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:44.055064 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:44.055481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:44.060115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:44.246687 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:44.265299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:44.266843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:44.268000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-698a6a84-d477-4b7f-8199-c3cc27134bd0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.227021 Oct 04 08:46:44.268575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 86/148] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:44 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:46:44.432846 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:44.433905 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:44.440827 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:44.441484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:44.442087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:44.442963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:44.443717 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:44.444457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:44.594205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:44.603760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7aefb196-83f5-40c5-a729-520ab0fe84ef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.176105 Oct 04 08:46:44.604318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 87/149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:44 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:44.629841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:44.630454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:44.636982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:44.637452 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:44.638106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:44.638969 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:44.639410 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:44.640144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:45.091283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:45.110021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-48762504-f2d4-4961-bee3-11f58fbf81ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.483893 Oct 04 08:46:45.111847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 88/150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:44 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:45.150154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7d582f33-71a7-4672-b9ff-61d6ca3a9e3d tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "POST /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.651887 Oct 04 08:46:45.151001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 63/151] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:46:41 2022] POST /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2/os-volume_attachments => generated 194 bytes in 3654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:45.298019 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:45.298625 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:45.307580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:45.308070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:45.308500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:45.309187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:45.309629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:45.310094 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:45.327087 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-ffbef1b4-2a0a-49ab-8bbd-9fc3b1426f62 req-7c9da101-c84e-4198-95b3-954a4b62c583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b03cac8-950a-405e-b19b-90a962f5c73f", "name": "network-vif-plugged", "status": "completed", "tag": "615440bd-a86a-4725-9efe-5cc93f1f22d9"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:45.344175 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ffbef1b4-2a0a-49ab-8bbd-9fc3b1426f62 req-7c9da101-c84e-4198-95b3-954a4b62c583 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:45.345374 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ffbef1b4-2a0a-49ab-8bbd-9fc3b1426f62 req-7c9da101-c84e-4198-95b3-954a4b62c583 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:45.346392 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-ffbef1b4-2a0a-49ab-8bbd-9fc3b1426f62 req-7c9da101-c84e-4198-95b3-954a4b62c583 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:45.367079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-ffbef1b4-2a0a-49ab-8bbd-9fc3b1426f62 req-7c9da101-c84e-4198-95b3-954a4b62c583 service nova] Creating event network-vif-plugged:615440bd-a86a-4725-9efe-5cc93f1f22d9 for instance 7b03cac8-950a-405e-b19b-90a962f5c73f on hv-cinder-86021 Oct 04 08:46:45.374822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-ffbef1b4-2a0a-49ab-8bbd-9fc3b1426f62 req-7c9da101-c84e-4198-95b3-954a4b62c583 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053462 Oct 04 08:46:45.376821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 64/152] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:46:45.447021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:45.455156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:45.456611 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:45.457815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ffefd78b-d414-4f0c-98cf-435ae1a6ee64 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.168863 Oct 04 08:46:45.458371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 89/153] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:45 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:45.630309 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:45.631341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:45.640687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:45.641185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:45.642232 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:45.642622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:45.643071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:45.643748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:45.783476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:45.791800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3afa9ce1-0834-44b1-bb2b-4f0d215bff8c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.167916 Oct 04 08:46:45.792359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 65/154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:45 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:46.136642 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:46.137257 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:46.143158 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:46.143648 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:46.144080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:46.144769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:46.145221 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:46.145645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:46.290527 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:46.302275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-be9efd4f-f772-4b2e-8ebd-c2026d4d16a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.169276 Oct 04 08:46:46.302903 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 90/155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:46 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:46.485659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:46.486848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:46.493677 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:46.494368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:46.495179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:46.495859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:46.496456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:46.497189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:46.691829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:46.701529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:46.703086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:46.704381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7572eaae-56b9-407b-b195-dc88a6406b1c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1407 microversion: 2.20 time: 0.222724 Oct 04 08:46:46.705078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 66/156] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:46 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:46:46.814672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:46.815279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:46.821652 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:46.822163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:46.822592 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:46.823269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:46.823741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:46.824156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:47.003435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:47.013923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3a3ac291-6483-43cf-97c2-cffab0a41691 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.201253 Oct 04 08:46:47.013923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 91/157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:46 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:47.327217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:47.327824 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:47.333795 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:47.335132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:47.335569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:47.336383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:47.337299 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:47.337740 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:47.394199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-0cc94743-5748-4f7b-83eb-304d6e9a70c7 req-14bd85e3-89df-4a6e-b4b5-c7204ed5602a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab02709a-3a90-4a5c-a268-deb0ab3e95c8", "name": "network-vif-plugged", "status": "completed", "tag": "0ccb9534-559a-4485-9935-ec9f4f50c53e"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:47.405016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0cc94743-5748-4f7b-83eb-304d6e9a70c7 req-14bd85e3-89df-4a6e-b4b5-c7204ed5602a service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:47.405553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0cc94743-5748-4f7b-83eb-304d6e9a70c7 req-14bd85e3-89df-4a6e-b4b5-c7204ed5602a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:47.406110 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0cc94743-5748-4f7b-83eb-304d6e9a70c7 req-14bd85e3-89df-4a6e-b4b5-c7204ed5602a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:47.419016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-0cc94743-5748-4f7b-83eb-304d6e9a70c7 req-14bd85e3-89df-4a6e-b4b5-c7204ed5602a service nova] Creating event network-vif-plugged:0ccb9534-559a-4485-9935-ec9f4f50c53e for instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 on hv-cinder-86021 Oct 04 08:46:47.424436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-0cc94743-5748-4f7b-83eb-304d6e9a70c7 req-14bd85e3-89df-4a6e-b4b5-c7204ed5602a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 Oct 04 08:46:47.425120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 92/158] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:46:47.478598 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:47.486678 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d5ce5092-1a21-46de-813b-ec209952c761 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1321 microversion: 2.1 time: 0.163801 Oct 04 08:46:47.487541 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 67/159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:47 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:47.732463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:47.733809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:47.744623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:47.745318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:47.746188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:47.746922 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:47.747705 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:47.747998 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:47.944485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:47.955620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:47.957886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:47.960628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-373d349b-af5c-4b2b-9717-601ee810bb08 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1598 microversion: 2.20 time: 0.231923 Oct 04 08:46:47.961519 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 93/160] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:46:47 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1598 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:47.987215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:47.987720 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:47.996258 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:47.997024 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:47.997648 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:47.998734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:47.999391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:47.999815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:48.035486 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:48.037090 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:48.044259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:48.044752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:48.045184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:48.045912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:48.046366 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:48.046989 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:48.123322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7dde1964-d653-466f-9be3-06098ff68fe6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139980 Oct 04 08:46:48.124062 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 68/161] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 4 08:46:47 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:46:48.514381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:48.515102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:48.522331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:48.522819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:48.523446 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:48.524381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:48.524917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:48.525542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:48.717072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:48.729578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0dd022f8-3f05-4809-9f69-6298f8118a05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1514 microversion: 2.1 time: 0.219383 Oct 04 08:46:48.730394 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 69/162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:48 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:48.754929 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:48.758613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:48.766155 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:48.766777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:48.767434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:48.768213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:48.768759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:48.769274 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:48.805822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lazy-loading 'flavor' on Instance uuid ba00a4bd-7048-40e3-8959-08035cc5d3f4 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:46:48.861569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:48.866958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:48.874942 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-961f3a6c-e8ea-4245-b39a-554e929f54f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.843083 Oct 04 08:46:48.875747 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 94/163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:48 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:48.977021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-98504842-e75e-401a-b249-ab8979ae0d38 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4/action" status: 200 len: 32 microversion: 2.1 time: 0.227317 Oct 04 08:46:48.977758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 70/164] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:46:48 2022] POST /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 08:46:48.987480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:48.988483 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:49.011003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:49.012066 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:49.012561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:49.017118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:49.020380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:49.021537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:49.597341 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:49.606020 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-90fcaecd-5e56-4225-9ba9-36f4e493d334 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.622639 Oct 04 08:46:49.618705 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 95/165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:48 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:49.901857 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:49.903699 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:49.911506 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:49.912194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:49.912729 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:49.913739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:49.914321 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:49.914846 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:50.174670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:50.197769 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-490118ab-25cd-4ffc-a5bb-7a7d2ababb27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.292081 Oct 04 08:46:50.198553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 71/166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:49 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:50.449970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-c2103680-1a15-4345-8292-0e1883f2010a req-fda4a97d-c5f7-44fc-a582-f78da35c3166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c490e2-0104-4fcb-b255-1f1c8b41c083", "tag": "3cedc437-d079-40c2-a255-95cbfb8ae43c"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:50.466522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-c2103680-1a15-4345-8292-0e1883f2010a req-fda4a97d-c5f7-44fc-a582-f78da35c3166 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:50.467002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-c2103680-1a15-4345-8292-0e1883f2010a req-fda4a97d-c5f7-44fc-a582-f78da35c3166 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:50.472173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-c2103680-1a15-4345-8292-0e1883f2010a req-fda4a97d-c5f7-44fc-a582-f78da35c3166 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:50.486364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-c2103680-1a15-4345-8292-0e1883f2010a req-fda4a97d-c5f7-44fc-a582-f78da35c3166 service nova] Creating event network-changed:3cedc437-d079-40c2-a255-95cbfb8ae43c for instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 on hv-cinder-86021 Oct 04 08:46:50.492820 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-c2103680-1a15-4345-8292-0e1883f2010a req-fda4a97d-c5f7-44fc-a582-f78da35c3166 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051081 Oct 04 08:46:50.494124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 96/167] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:50.634121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:50.635104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:50.643914 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:50.644688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:50.645469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:50.646548 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:50.647034 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:50.647459 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:50.850490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:50.860406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a2d59613-a36c-41df-b9fd-5e12460a0d34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.234083 Oct 04 08:46:50.861652 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 72/168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:50 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:51.226947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:51.229978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:51.246456 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:51.246955 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:51.247389 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:51.248090 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:51.248544 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:51.248964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:51.438659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:51.449982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-283379f6-58be-4eae-9848-9e4eb20ab516 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1367 microversion: 2.1 time: 0.230081 Oct 04 08:46:51.465559 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 97/169] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:51 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:51.884829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:51.885392 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:51.892564 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:51.893067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:51.893489 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:51.894196 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:51.894924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:51.895192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:52.060111 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:52.069281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2c1dc6a1-1db2-4c63-8359-d15d8eef7ff4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.188526 Oct 04 08:46:52.070010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 73/170] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:51 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:52.473754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:52.475014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:52.483522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:52.484116 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:52.484761 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:52.486980 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:52.487726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:52.488323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:52.700687 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:52.709863 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-449148d5-3a36-4656-bf9d-2a25fd003835 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1557 microversion: 2.1 time: 0.240037 Oct 04 08:46:52.710523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 98/171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:52 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1557 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:52.735031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:52.735648 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:52.742262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:52.742755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:52.743192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:52.743891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:52.744349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:52.744770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:52.821398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b18366fa-ae86-44b3-8076-d205cdc53b44 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090138 Oct 04 08:46:52.822058 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 74/172] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 08:46:52 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:53.092598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:53.093718 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:53.103602 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:53.105101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:53.106308 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:53.108307 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:53.110305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:53.111951 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:53.525540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:53.535318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-877ef8cb-4df3-4132-b080-b5042a7eac75 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.446758 Oct 04 08:46:53.536000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 99/173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:53 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:54.262383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-e7a1a127-ca1a-47cf-9f7f-cb7353085017 req-8628f7c0-069a-4d9e-9f6e-5da3b287ac29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b03cac8-950a-405e-b19b-90a962f5c73f", "tag": "615440bd-a86a-4725-9efe-5cc93f1f22d9"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:46:54.271891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e7a1a127-ca1a-47cf-9f7f-cb7353085017 req-8628f7c0-069a-4d9e-9f6e-5da3b287ac29 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:54.272445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e7a1a127-ca1a-47cf-9f7f-cb7353085017 req-8628f7c0-069a-4d9e-9f6e-5da3b287ac29 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:54.272947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e7a1a127-ca1a-47cf-9f7f-cb7353085017 req-8628f7c0-069a-4d9e-9f6e-5da3b287ac29 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:54.283904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-e7a1a127-ca1a-47cf-9f7f-cb7353085017 req-8628f7c0-069a-4d9e-9f6e-5da3b287ac29 service nova] Creating event network-changed:615440bd-a86a-4725-9efe-5cc93f1f22d9 for instance 7b03cac8-950a-405e-b19b-90a962f5c73f on hv-cinder-86021 Oct 04 08:46:54.289623 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-e7a1a127-ca1a-47cf-9f7f-cb7353085017 req-8628f7c0-069a-4d9e-9f6e-5da3b287ac29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031376 Oct 04 08:46:54.290620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 75/174] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:54.559212 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:54.559838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:54.565992 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:54.566482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:54.566915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:54.567608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:54.568055 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:54.568532 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:54.706556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:54.714899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a5aff88e-331e-497e-bb70-fdf2d5aa75fa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.159497 Oct 04 08:46:54.715564 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 100/175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:54 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:55.739324 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:55.740004 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:55.746624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:55.747096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:55.747522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:55.748197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:55.748637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:55.749053 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:55.877381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:55.885091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e295b818-47b7-4358-a31b-df079cfb309b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.150443 Oct 04 08:46:55.885657 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 76/176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:55 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:56.907865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:56.908740 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:56.914618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:56.915108 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:56.915526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:56.916218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:56.916666 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:56.917086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:57.048723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:57.056948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8293d992-35e7-4228-be8f-cb8073015ca8 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.153292 Oct 04 08:46:57.057507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 101/177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:56 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:58.079596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:58.080140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:58.087286 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:58.088458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:58.088924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:58.089848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:58.090895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:58.090895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:58.218832 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:58.226785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-201c4799-2736-4605-8f4c-c7f59f7dd319 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.151039 Oct 04 08:46:58.227342 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 77/178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:58 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:59.248524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:59.249134 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:46:59.255230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:59.255714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:59.256248 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:59.256894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:46:59.257343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:46:59.257804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:46:59.384572 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:46:59.392151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-14d0882a-16cd-45b8-832b-302336dc4a16 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.147432 Oct 04 08:46:59.392715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 102/179] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:46:59 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:00.415534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:00.416162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:00.422443 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:00.422923 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:00.423346 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:00.424019 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:00.424471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:00.424880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:00.553951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:00.561926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f8fa7d90-5328-4a78-94bc-7e3a760be3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.150660 Oct 04 08:47:00.562499 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 78/180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:00 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:01.321305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:01.321834 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:01.327751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:01.328229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:01.328661 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:01.329343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:01.329822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:01.330245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:01.354256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:47:01.392859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:01.482475 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5435a40d-0946-475e-886d-1b2ba124c0cc tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 204 len: 0 microversion: 2.1 time: 0.165858 Oct 04 08:47:01.482974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 103/181] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:47:01 2022] DELETE /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:47:01.492074 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:01.492688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:01.499433 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:01.499917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:01.500342 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:01.501029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:01.501473 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:01.501915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:01.584779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:01.585485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:01.592301 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:01.592797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:01.593507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:01.594113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:01.594667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:01.595088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:01.633604 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:01.642066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cb7aa01b-d792-458b-95f0-6ccfc955d00e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.154620 Oct 04 08:47:01.642644 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 79/182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:01 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:01.727819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:01.735404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9ee32bcf-8376-44aa-9bad-65e8c88b8f34 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.154835 Oct 04 08:47:01.735902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 104/183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:01 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:02.664886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:02.665492 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:02.671958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:02.672427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:02.672852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:02.673520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:02.673996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:02.674410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:02.757057 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:02.757668 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:02.763771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:02.764262 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:02.764698 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:02.765395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:02.765888 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:02.766318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:02.799480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:02.807759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b53440bd-5c69-4790-90f5-bc964b16954c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.147201 Oct 04 08:47:02.808333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 80/184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:02 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:02.895202 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:02.903494 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-55919cba-e9d9-4e58-b911-25d2e9e77afa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.150227 Oct 04 08:47:02.904064 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 105/185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:02 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:03.831280 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:03.831881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:03.838315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:03.838791 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:03.839216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:03.839885 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:03.840328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:03.840739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:03.926168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:03.926854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:03.933476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:03.934082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:03.934589 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:03.935340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:03.935892 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:03.936319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:03.970949 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:03.979895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c6f910b8-b21c-44e2-93af-330644a55f65 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.152313 Oct 04 08:47:03.980609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 81/186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:03 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:04.070256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:04.077786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fd5a772a-37d5-49d4-8115-ef1e2fcbb1a3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.155457 Oct 04 08:47:04.078344 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 106/187] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:03 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:05.002158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:05.002777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:05.009126 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:05.009604 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:05.010140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:05.010825 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:05.011278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:05.011700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:05.099583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:05.100200 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:05.106603 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:05.107096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:05.107529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:05.108221 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:05.108674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:05.109099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:05.141884 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:05.150579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c5e6f681-a901-4062-b775-3587694b616e tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.152262 Oct 04 08:47:05.165718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 82/188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:04 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:05.235506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:05.243108 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f97976a6-6d43-4e1d-9909-f15af3f4ccc6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.147384 Oct 04 08:47:05.243672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 107/189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:05 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:06.173510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:06.174142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:06.181028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:06.181511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:06.181979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:06.182659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:06.183108 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:06.183524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:06.265936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:06.266543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:06.273188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:06.273670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:06.274185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:06.274851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:06.275366 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:06.275802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:06.323712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:06.332287 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e746ae4a-a193-4529-b2f2-90d4fb2a7911 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.162576 Oct 04 08:47:06.332910 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 83/190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:06 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:06.418719 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:06.426615 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a81bf931-1bf1-43e7-aa4c-2b88ca39ae2e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.164402 Oct 04 08:47:06.427227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 108/191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:06 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:07.357843 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:07.358448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:07.364670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:07.365715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:07.366146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:07.366821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:07.367265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:07.367683 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:07.448262 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:07.448990 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:07.455317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:07.456285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:07.456728 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:07.457425 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:07.457922 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:07.458353 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:07.494191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:07.502383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2a326165-b7d3-4e3a-a227-dbab9eddc307 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.148295 Oct 04 08:47:07.502960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 84/192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:07 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:07.588840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:07.596926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d5344cff-2047-40b1-bf2b-4a372806d050 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.152454 Oct 04 08:47:07.597751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 109/193] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:07 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:08.525383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:08.526055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:08.528600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=57 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:08.533807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:08.534282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:08.534709 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:08.535386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:08.535830 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:08.536242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:08.619822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:08.620437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:08.626389 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:08.626923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:08.627304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:08.627995 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:08.628449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:08.628871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:08.664029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:08.672234 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-df5aae2d-c4af-4925-9619-fa6ba4c3b179 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.150766 Oct 04 08:47:08.672811 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 85/194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:08 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:08.758618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:08.766168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4ace5c07-d97d-40c0-88ac-b193753aa245 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.150121 Oct 04 08:47:08.766732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 110/195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:08 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:09.696266 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:09.696878 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:09.703309 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:09.703788 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:09.704257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:09.704948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:09.705402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:09.705853 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:09.788948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:09.789556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:09.791539 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:09.796686 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:09.797169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:09.797603 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:09.798315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:09.798806 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:09.799225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:09.839047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:09.842527 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:09.849423 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1d3f4bbc-de10-46a5-8f7a-28ee1f1d2595 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.156525 Oct 04 08:47:09.850028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 86/196] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:09 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:09.933703 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:09.941362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3ebd30f7-c52f-491e-90ee-05d0d04db85f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.156842 Oct 04 08:47:09.941965 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 111/197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:09 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:10.872025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:10.872635 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:10.880625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:10.881119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:10.881552 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:10.882274 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:10.882728 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:10.883150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:10.964145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:10.964746 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:10.970923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:10.971341 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:10.971767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:10.972444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:10.972889 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:10.973304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:11.018569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:11.027458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b6ebeb39-85f2-423e-89db-bfec21223575 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.159258 Oct 04 08:47:11.028047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 87/198] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:10 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:11.112829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:11.120759 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7f806747-a32b-4e13-b79c-a85805dfcdf2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.160425 Oct 04 08:47:11.121353 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 112/199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:10 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:12.051161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:12.051781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:12.058623 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:12.059110 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:12.059576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:12.060267 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:12.060780 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:12.061246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:12.143025 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:12.143662 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:12.149706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:12.150208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:12.150643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:12.151333 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:12.151781 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:12.152199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:12.189594 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:12.210675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4bae54c2-0128-426b-be7c-6cd6abc7f26a tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.163572 Oct 04 08:47:12.211261 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 88/200] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:12 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:12.287123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:12.294790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-09d38a89-61a5-4a28-8abc-fe6f2a44d297 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.155798 Oct 04 08:47:12.295355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 113/201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:12 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:13.239320 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:13.240688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:13.247750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:13.248208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:13.248642 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:13.249336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:13.249814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:13.250243 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:13.319805 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:13.320627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:13.327071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:13.328011 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:13.328667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:13.329596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:13.337277 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:13.338168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:13.427000 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:13.436500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3edb846d-4f07-4c71-83b3-a30282689cc3 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1554 microversion: 2.1 time: 0.201368 Oct 04 08:47:13.437679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 89/202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:13 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:13.501486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-30a41afd-79fe-4c30-95e9-79ad308530b4 req-d790cb0f-ae78-4d1c-97be-dbdb3e3e31f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb90b4ee-26be-43ad-93c1-458a94c15bd2", "name": "network-vif-deleted", "tag": "cc4bf9bf-a7c3-43e2-bb42-849e6af4f9de"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:47:13.514939 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-30a41afd-79fe-4c30-95e9-79ad308530b4 req-d790cb0f-ae78-4d1c-97be-dbdb3e3e31f1 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:13.516441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-30a41afd-79fe-4c30-95e9-79ad308530b4 req-d790cb0f-ae78-4d1c-97be-dbdb3e3e31f1 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:13.517149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-30a41afd-79fe-4c30-95e9-79ad308530b4 req-d790cb0f-ae78-4d1c-97be-dbdb3e3e31f1 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:13.537145 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-30a41afd-79fe-4c30-95e9-79ad308530b4 req-d790cb0f-ae78-4d1c-97be-dbdb3e3e31f1 service nova] Creating event network-vif-deleted:cc4bf9bf-a7c3-43e2-bb42-849e6af4f9de for instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 on hv-cinder-86021 Oct 04 08:47:13.551283 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-30a41afd-79fe-4c30-95e9-79ad308530b4 req-d790cb0f-ae78-4d1c-97be-dbdb3e3e31f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050608 Oct 04 08:47:13.552157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 90/203] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:47:13.574036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:13.582152 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-effd792e-9fb6-451e-866f-b437d00dd835 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.268229 Oct 04 08:47:13.583968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 114/204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:13 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:14.464178 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:14.465126 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:14.472043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:14.472589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:14.473196 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:14.474588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:14.475052 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:14.475479 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:14.506059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:14.506533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:14.506959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:14.507398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lazy-loading 'fault' on Instance uuid bb90b4ee-26be-43ad-93c1-458a94c15bd2 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:47:14.575087 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980f097960df41528ac45d6c5a07c5f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7229cfcf52b64e83914f4ea2eb5627dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:14.584273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4ecb2675-bb14-4ec3-9b57-6715a098b4f6 tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 200 len: 1351 microversion: 2.1 time: 0.124895 Oct 04 08:47:14.585115 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 91/205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:14 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:14.607278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:14.607278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:14.613067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:14.613551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:14.614199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:14.615433 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:14.615886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:14.616306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:14.782896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:14.797054 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-31fd8199-e0cc-4672-9f95-464fe2a0dac2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.194227 Oct 04 08:47:14.812947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 115/206] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:14 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:15.608974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:15.609845 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:15.616614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:15.617166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:15.617618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:15.618401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:15.619071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:15.619751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:15.640813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] HTTP exception thrown: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Request method failure captured: Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 HTTP/1.1 Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_K8dUgS00pjbxDnX-npH1idsZQ8aiVRKon7H5G2iA7sZw0u3Qkjue554UsNx1QsTw24oVF6Ti_IzI3fXJ2ccdUnf9v4VgrF2_rd9z2vhvz3dbapMqfqzwW6MwKI41afNU195nJKWzFiQXoyv0fwUbZpIuXLS5eOP-Hn2VQZAA3mDmw Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:47:15.646116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}] Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 980f097960df41528ac45d6c5a07c5f5 Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.647651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'bb90b4ee-26be-43ad-93c1-458a94c15bd2'} Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:47:15.648581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.650199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.651224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Returning 404 to user: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:47:15.651224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ebb95e95-2df0-4072-a550-5e93f3eecdec tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 404 len: 111 microversion: 2.1 time: 0.043612 Oct 04 08:47:15.651224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 92/207] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:15 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:47:15.823474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:15.825739 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:15.832035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:15.832697 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:15.833964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:15.834835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:15.835434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:15.836073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:15.910373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:15.913122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:15.919413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:15.920120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:15.920713 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:15.921878 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:15.922322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:15.922911 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:15.938840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] HTTP exception thrown: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Request method failure captured: Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2/os-volume_attachments HTTP/1.1 Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_K8dUgS00pjbxDnX-npH1idsZQ8aiVRKon7H5G2iA7sZw0u3Qkjue554UsNx1QsTw24oVF6Ti_IzI3fXJ2ccdUnf9v4VgrF2_rd9z2vhvz3dbapMqfqzwW6MwKI41afNU195nJKWzFiQXoyv0fwUbZpIuXLS5eOP-Hn2VQZAA3mDmw Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:47:15.940622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}] Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 980f097960df41528ac45d6c5a07c5f5 Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.941814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'server_id': 'bb90b4ee-26be-43ad-93c1-458a94c15bd2'} Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:47:15.943082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:15.944753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:15.946404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Returning 404 to user: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:47:15.946404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-88f42d54-8b6f-41fb-b329-fe5ecf0b561c tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036485 Oct 04 08:47:15.946404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 93/208] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:47:15 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:47:16.001393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:16.026779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6c3f5706-c813-457e-b33f-16565c9444b0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.207463 Oct 04 08:47:16.037237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 116/209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:15 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:17.051125 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:17.051728 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:17.058140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:17.058615 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:17.059038 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:17.059716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:17.060191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:17.060609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:17.184206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:17.184716 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:17.188263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:17.190555 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:17.191032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:17.191464 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:17.192147 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:17.193102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:17.193516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:17.196495 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-653e18db-0fb9-4309-896c-77937ce2b386 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.149221 Oct 04 08:47:17.197051 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 94/210] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:17 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:17.207472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] HTTP exception thrown: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Request method failure captured: Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 HTTP/1.1 Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_K8dUgS00pjbxDnX-npH1idsZQ8aiVRKon7H5G2iA7sZw0u3Qkjue554UsNx1QsTw24oVF6Ti_IzI3fXJ2ccdUnf9v4VgrF2_rd9z2vhvz3dbapMqfqzwW6MwKI41afNU195nJKWzFiQXoyv0fwUbZpIuXLS5eOP-Hn2VQZAA3mDmw Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:47:17.212678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}] Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 980f097960df41528ac45d6c5a07c5f5 Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.214185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'bb90b4ee-26be-43ad-93c1-458a94c15bd2'} Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:47:17.215314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.216472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.217777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Returning 404 to user: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:47:17.217777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-931c3013-f16f-4314-9ff0-6f8093d747ee tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 404 len: 111 microversion: 2.1 time: 0.033756 Oct 04 08:47:17.217777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 117/211] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:47:17 2022] DELETE /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:47:17.222653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:17.223258 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] [instance: bb90b4ee-26be-43ad-93c1-458a94c15bd2] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:17.229043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:17.229513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:17.230009 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:17.230687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:17.231128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:17.231544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:17.244662 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] HTTP exception thrown: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Request method failure captured: Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 HTTP/1.1 Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_K8dUgS00pjbxDnX-npH1idsZQ8aiVRKon7H5G2iA7sZw0u3Qkjue554UsNx1QsTw24oVF6Ti_IzI3fXJ2ccdUnf9v4VgrF2_rd9z2vhvz3dbapMqfqzwW6MwKI41afNU195nJKWzFiQXoyv0fwUbZpIuXLS5eOP-Hn2VQZAA3mDmw Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:47:17.246209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7229cfcf52b64e83914f4ea2eb5627dd"}]}] Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 7229cfcf52b64e83914f4ea2eb5627dd Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-DeleteServersTestJSON-1060481784 Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 980f097960df41528ac45d6c5a07c5f5 Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-DeleteServersTestJSON-1060481784-project Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.247432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'bb90b4ee-26be-43ad-93c1-458a94c15bd2'} Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:47:17.248225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. Oct 04 08:47:17.249588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:17.250755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] Returning 404 to user: Instance bb90b4ee-26be-43ad-93c1-458a94c15bd2 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:47:17.250755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-220757d7-1c28-4099-b700-a8692376ca0b tempest-DeleteServersTestJSON-1060481784 tempest-DeleteServersTestJSON-1060481784-project] 10.222.0.26 "GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2" status: 404 len: 111 microversion: 2.1 time: 0.028919 Oct 04 08:47:17.250755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 95/212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:17 2022] GET /compute/v2.1/servers/bb90b4ee-26be-43ad-93c1-458a94c15bd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:47:18.220778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:18.221477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:18.228111 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:18.228588 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:18.229011 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:18.229907 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:18.230448 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:18.230852 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:18.361240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:18.370365 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4c918c41-8f60-40d3-b107-38731115a83d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.153742 Oct 04 08:47:18.371120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 118/213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:18 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:19.392289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:19.392902 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:19.399645 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:19.400131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:19.400567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:19.401257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:19.401726 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:19.402153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:19.531565 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:19.539404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-00dc5304-bb0e-4ded-9c05-9e8feccf20b1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.150937 Oct 04 08:47:19.539960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 96/214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:19 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:20.562265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:20.563420 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:20.569847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:20.570323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:20.570751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:20.571427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:20.571892 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:20.572312 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:20.708694 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:20.712135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:20.717178 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ab170107-0714-4e71-bcdf-bc78cb6dd82c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.158963 Oct 04 08:47:20.717770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 119/215] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:20 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:21.740329 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:21.740953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:21.751512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:21.751512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:21.751723 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:21.752436 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:21.752895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:21.753325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:21.906022 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:21.914509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-17a26f5d-e844-4634-a476-6ffc7764ff06 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.177986 Oct 04 08:47:21.915117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 97/216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:21 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:22.936230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:22.936777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:22.944083 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:22.944563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:22.944991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:22.945678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:22.946146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:22.946561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:23.084501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:23.092220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-05672ed1-4c20-49a8-86b2-c743c919f606 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.159851 Oct 04 08:47:23.092773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 120/217] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:22 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:24.114428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:24.115568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:24.126367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:24.126367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:24.126367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:24.126367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:24.126659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:24.126659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:24.261951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:24.269797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-602ac280-ad98-476e-b97b-dc518ba7c2ee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.159111 Oct 04 08:47:24.270411 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 98/218] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:24 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:25.292745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:25.293414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:25.299684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:25.300165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:25.300591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:25.301835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:25.302284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:25.302702 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:25.463101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:25.471805 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-11f91081-ab27-4761-943b-9bffb7ac94bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.182925 Oct 04 08:47:25.472372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 121/219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:25 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:26.494075 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:26.494606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:26.503941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:26.504432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:26.504883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:26.505799 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:26.506266 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:26.506683 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:26.634975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:26.642719 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ee630049-a1fb-4828-b04c-3c33a8777c5e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.152754 Oct 04 08:47:26.643291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 99/220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:26 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:27.666680 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:27.667289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:27.673210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:27.673708 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:27.674137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:27.674836 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:27.675282 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:27.675701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:27.806658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:27.814178 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b2872624-1636-4abc-99b9-f6b7856dc1e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.151359 Oct 04 08:47:27.814734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 122/221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:27 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:28.837127 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:28.837753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:28.844338 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:28.844822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:28.845262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:28.845971 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:28.846426 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:28.846850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:28.973770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:28.981527 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e8481276-9f38-4acd-88f5-445ef59df7c3 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.148258 Oct 04 08:47:28.982124 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 100/222] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:28 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:30.005272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:30.005900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:30.011936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:30.012413 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:30.012842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:30.013518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:30.013988 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:30.014405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:30.137600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:30.145949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ebc206dc-ccd9-4f50-8890-659991113e63 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.145105 Oct 04 08:47:30.146529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 123/223] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:29 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:31.168368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:31.168992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:31.175408 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:31.176385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:31.176839 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:31.177514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:31.177979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:31.178404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:31.306708 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:31.314263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ddbe4eb4-f711-4b2f-b345-e8de0eec4649 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.149705 Oct 04 08:47:31.314820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 101/224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:31 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:32.338337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:32.338949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:32.345379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:32.345904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:32.346340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:32.347024 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:32.347476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:32.348414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:32.478072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:32.485776 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ac7c53d4-d862-494a-9c73-c4439d50b206 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.151189 Oct 04 08:47:32.486243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 124/225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:32 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:33.511573 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:33.512215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:33.518821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:33.519299 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:33.519732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:33.520417 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:33.520863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:33.521279 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:33.654774 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:33.663755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cb141bc1-33ca-4c81-890e-45e2418fce40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.155908 Oct 04 08:47:33.664323 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 102/226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:33 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:34.686481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:34.687095 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:34.692843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:34.693324 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:34.693792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:34.694477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:34.694929 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:34.695351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:34.828859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:34.836679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2293d7de-1d5a-431e-bf86-4adfa2b572bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1500 microversion: 2.1 time: 0.154021 Oct 04 08:47:34.837253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 125/227] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:34 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:34.859109 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:34.860264 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:34.867596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:34.868066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:34.868491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:34.869419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:34.869829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:34.870254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:35.012357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:35.020025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d8f72857-c3a8-4b8f-a35c-e29a866c4c1f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1515 microversion: 2.1 time: 0.164924 Oct 04 08:47:35.020583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 103/228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:34 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:37.440658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:47:37.443393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:37.449232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:37.449746 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:37.450185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:37.450873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:37.451329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:37.451753 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:37.474713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lazy-loading 'flavor' on Instance uuid ab02709a-3a90-4a5c-a268-deb0ab3e95c8 {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:47:37.579563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-20cb540e-0e14-4d6c-a005-a346d8aaf047 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8/action" status: 200 len: 32 microversion: 2.1 time: 0.142899 Oct 04 08:47:37.580163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 126/229] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:47:37 2022] POST /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:47:37.590671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:37.591275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:37.599071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:37.600217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:37.600652 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:37.601710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:37.602180 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:37.602605 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:37.734778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:37.743859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ac5bf1cd-b753-4070-95f2-269fa70e4f40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.156900 Oct 04 08:47:37.750931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 104/230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:37 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:38.767226 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:38.767943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:38.774660 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:38.775147 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:38.775583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:38.776270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:38.776725 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:38.777148 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:38.905933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:38.914230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d7f6ac4c-7929-4c3f-bd98-94f30b10cecd tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.151290 Oct 04 08:47:38.914780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 127/231] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:38 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:39.939513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:39.940133 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:39.943179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=42 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:39.948525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:39.949014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:39.949449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:39.950174 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:39.950628 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:39.951054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:40.085017 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:40.088525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:40.093459 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8a1d9322-648f-45fc-97c1-5247692de3e6 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.157772 Oct 04 08:47:40.094324 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 105/232] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:39 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:41.116609 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:41.117209 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:41.119233 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=34 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:41.124336 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:41.124855 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:41.125283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:41.125983 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:41.126427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:41.126838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:41.254625 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:41.262129 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0d05d179-12b6-48fb-8c47-23cd279ff148 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.149998 Oct 04 08:47:41.262696 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 128/233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:41 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:42.284943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:42.285559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:42.291619 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:42.292099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:42.292534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:42.293345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:42.293822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:42.294246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:42.431580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:42.439204 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fdd918ed-664b-4658-aa4b-006a1d0bf354 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.158712 Oct 04 08:47:42.439768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 106/234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:42 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:43.462399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:43.463011 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:43.469593 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:43.470113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:43.470548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:43.471245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:43.471691 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:43.472132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:43.601656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:43.609489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b5eb1e6c-3616-45b1-bcd5-ad5af0736ee2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.150827 Oct 04 08:47:43.610021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 129/235] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:43 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:44.633435 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:44.634510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:44.641563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:44.642021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:44.642448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:44.643138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:44.643581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:44.644029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:44.928690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:44.936602 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6a77ff14-3c17-4112-bbff-db8746598a20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.308053 Oct 04 08:47:44.937166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 107/236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:44 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:45.973541 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:45.974168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:45.980409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:45.980893 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:45.981537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:45.982278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:45.983039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:45.983465 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:46.133250 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:46.142016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4cd392a8-a60c-4e72-9a84-d4567fcefc56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.174839 Oct 04 08:47:46.142594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 130/237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:45 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:47.164791 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:47.165787 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:47.173106 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:47.173814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:47.174616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:47.176199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:47.176991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:47.177569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:47.343168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:47.353254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a9680697-63fd-43df-8cd4-31e4ed9471b2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.192189 Oct 04 08:47:47.354584 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 108/238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:47 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:47:48.378070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:48.378727 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:48.384576 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:48.385056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:48.385512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:48.386225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:48.386677 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:48.387102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:48.515832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:48.523505 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c9c1ceed-c30a-4461-a72d-74da40136215 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.149512 Oct 04 08:47:48.524070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 131/239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:48 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:49.546512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:49.547863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:49.556487 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:49.556899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:49.557327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:49.558293 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:49.558748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:49.559210 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:49.716249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:49.724695 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f169b7bb-db4b-4b44-af79-789d0d02e6c5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.182019 Oct 04 08:47:49.725539 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 109/240] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:49 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:50.749919 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:50.750599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:50.759628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:50.763126 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:50.763644 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:50.764404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:50.764934 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:50.766021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:50.953911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:50.963667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-eab01716-3c64-483c-b851-52acabdc6897 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.219192 Oct 04 08:47:50.964528 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 132/241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:50 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:51.988443 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:51.989543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:51.997186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:51.997734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:51.998217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:51.999032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:51.999607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:52.000036 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:52.223879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:52.242545 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-07f0dd78-5342-4c13-9d53-0f6fb25488b7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.257155 Oct 04 08:47:52.243155 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 110/242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:51 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:53.270102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:53.270899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:53.279794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:53.282182 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:53.283355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:53.284314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:53.285290 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:53.285734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:53.288780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:53.480447 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:53.489609 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-112140a2-c152-4c37-ac69-e9e0fcbbd8f7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.223860 Oct 04 08:47:53.490883 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 133/243] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:53 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:54.520619 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:54.521284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:54.534773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:54.535115 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:54.535748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:54.536861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:54.537629 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:54.538362 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:54.761525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:54.773537 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cd072511-8ea5-4790-8ae1-4122ff3eed9b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.256761 Oct 04 08:47:54.775432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 111/244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:54 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:55.796743 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:55.797492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:55.809817 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:55.810472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:55.811061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:55.811953 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:55.812550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:55.817904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:56.217041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:56.234896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-19e8fb90-7fa2-43d8-9b09-a120dd3bcf58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.441787 Oct 04 08:47:56.236315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 134/245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:55 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:57.260204 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:57.261505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:57.269117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:57.269796 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:57.270358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:57.271222 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:57.271928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:57.272449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:57.448492 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:57.464188 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-38fad510-e839-4415-98c9-8b5e47c60bd2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.208368 Oct 04 08:47:57.464764 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 112/246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:57 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:58.490439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:58.491084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:58.500197 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:58.500689 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:58.501133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:58.502621 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:58.503129 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:58.503584 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:58.781421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:58.794326 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-af6f5559-1bf1-469a-b560-4315923eda3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1501 microversion: 2.1 time: 0.308698 Oct 04 08:47:58.794931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 135/247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:58 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:47:58.819742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9608c552-f180-491c-8779-74710ca8773c"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:47:58.822342 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:58.833441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:58.834210 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:58.834500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:58.835128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:58.835580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:58.836004 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:58.900579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] HTTP exception thrown: Cannot 'attach_volume' instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 while it is in vm_state rescued Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Request method failure captured: Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: POST /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8/os-volume_attachments HTTP/1.1 Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 74 Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LFl7xKXNfF9BfAgAnIN4w4ISqldMi8hBBZcCI7rcHZibCN8zsPrTIGBG6JnFl3MtYZHlNjdg42i7uQb2P5Ypp6OhGpYoVd4S0aChqIAhnHQ8t59fylgmlx_HVA1GNV9w92vrqm4HmQGY0tm-Vt1sHFUvt-kg6M82-7GNA-5KG5mxI Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:47:58.902591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b7703aae5634dabb496bc221882863c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b7703aae5634dabb496bc221882863c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}] Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: acf57eb971eb4f78b173a5ab47160bd1 Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {"volumeAttachment": {"volumeId": "9608c552-f180-491c-8779-74710ca8773c"}} Oct 04 08:47:58.904143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Cannot 'attach_volume' instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 while it is in vm_state rescued Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'server_id': 'ab02709a-3a90-4a5c-a268-deb0ab3e95c8', 'body': {'volumeAttachment': {'volumeId': '9608c552-f180-491c-8779-74710ca8773c'}}} Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:47:58.905028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 while it is in vm_state rescued Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:47:58.906316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:47:58.907431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:47:58.907431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:47:58.907431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 while it is in vm_state rescued Oct 04 08:47:58.907431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:47:58.907431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Returning 409 to user: Cannot 'attach_volume' instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 while it is in vm_state rescued {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:47:58.907431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f39de9fb-cd5a-460b-92f9-f8284d86da19 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.092370 Oct 04 08:47:58.907978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 113/248] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:47:58 2022] POST /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 08:47:58.917763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:47:58.918545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:58.929602 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:58.930404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:58.930862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:58.933280 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:58.933787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:58.934222 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:59.056006 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0047e9c9-7320-4b14-b4a8-60807165b792 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8/action" status: 202 len: 0 microversion: 2.1 time: 0.142353 Oct 04 08:47:59.056658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 136/249] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:47:58 2022] POST /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:47:59.067582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:47:59.069823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:47:59.084509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:59.085078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:59.086799 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:59.088623 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:47:59.089152 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:47:59.092274 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:47:59.407661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:47:59.417269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f72cda15-2e93-416b-811f-a933273182ba tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1509 microversion: 2.1 time: 0.355221 Oct 04 08:47:59.420633 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 114/250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:47:59 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:00.447655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:00.448898 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:00.460398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:00.464843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:00.466269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:00.468033 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:00.469842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:00.471742 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:00.816860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:00.825190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4187a07c-5600-4187-8548-e72c640b66bf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1509 microversion: 2.1 time: 0.382057 Oct 04 08:48:00.826339 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 137/251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:00 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:01.849902 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:01.851615 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:01.867526 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:01.868016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:01.868463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:01.873611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:01.874142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:01.874582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:02.265859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:02.277637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-33fdf588-a6d6-4907-94bb-c75169dba599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1509 microversion: 2.1 time: 0.432101 Oct 04 08:48:02.282336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 115/252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:01 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:03.303853 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:03.304468 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:03.311329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:03.312270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:03.312869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:03.313772 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:03.314385 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:03.314805 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:03.528778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:03.549291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a66a528b-48d1-4a84-a6e4-9893d0e60274 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1515 microversion: 2.1 time: 0.249810 Oct 04 08:48:03.552126 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 138/253] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:03 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1515 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:04.265333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1185860563", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "networks": [{"uuid": "b2c6ee9e-c46f-4eab-9634-c27c98795f15"}]}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:04.357871 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] validate_networks() for [('b2c6ee9e-c46f-4eab-9634-c27c98795f15', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:48:05.011772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:48:05.012436 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:48:05.013214 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:48:05.013870 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:48:05.014491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:48:05.024803 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:05.025959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:05.026605 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:05.027801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:05.028456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:05.029086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:05.054443 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Getting quotas for project 47f943270eaa45a4b5aec895741d553d. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:48:05.059211 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Getting quotas for user efea00dacdca4d1d8e919fb446e164ea and project 47f943270eaa45a4b5aec895741d553d. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:48:05.077942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:48:05.080886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:48:05.176441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e6557394-ee7e-43b9-afc6-416e9701269c tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921134 Oct 04 08:48:05.178180 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 116/254] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:48:05.192670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ee85f76a-89f2-4105-bedc-50e4d35283c4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:05.193950 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ee85f76a-89f2-4105-bedc-50e4d35283c4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:05.364380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ee85f76a-89f2-4105-bedc-50e4d35283c4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:05.375612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ee85f76a-89f2-4105-bedc-50e4d35283c4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1214 microversion: 2.1 time: 0.190990 Oct 04 08:48:05.376436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 139/255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:05 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:06.400341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:06.400971 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:06.415452 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:06.416168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:06.416781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:06.422317 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:06.422839 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:06.425434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:06.431054 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-68763d1c-e148-4061-9156-ccc7dada5f79 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'create', calling method: .version_select at 0x7f5fd43e20d0>, body: {"keypair": {"name": "tempest-keypair-124092331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7xarwi/69NPAEXiAM3SnFSi7/f+ARLVO+SCb82/UATCHFm4wppXaQlceVEpZgH4vdmWy62PuO5pSKfgQmYr07FGCJmW+QcUk+/lKqdPmeKdeqWXSewNPnt8X4OyD8rYQ=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:06.527574 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:06.536879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5f18fea7-18be-404c-a969-4188d86f7586 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1266 microversion: 2.1 time: 0.141154 Oct 04 08:48:06.553366 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 117/256] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:06 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:06.624342 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-68763d1c-e148-4061-9156-ccc7dada5f79 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for project 0b7703aae5634dabb496bc221882863c. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:48:06.628943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-68763d1c-e148-4061-9156-ccc7dada5f79 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for user acf57eb971eb4f78b173a5ab47160bd1 and project 0b7703aae5634dabb496bc221882863c. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:48:06.657565 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-68763d1c-e148-4061-9156-ccc7dada5f79 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.230746 Oct 04 08:48:06.658746 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 140/257] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:48:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:07.560850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:07.561459 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:07.571801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:07.572588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:07.573207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:07.574166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:07.574826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:07.575618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:07.748914 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:07.768544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e526f13d-0dd4-4d6d-aa6d-02ee77b65e4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1272 microversion: 2.1 time: 0.211498 Oct 04 08:48:07.769445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 118/258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:07 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:08.792304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:08.793815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:08.807675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:08.808423 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:08.809755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:08.810846 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:08.811650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:08.812214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:09.003651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-299596173", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23796c7f-d7b7-4b78-a709-9c1a747eda10"}], "security_groups": [{"name": "tempest-securitygroup--1883205228"}], "key_name": "tempest-keypair-124092331", "user_data": "}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:09.101683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:09.116863 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-972777bc-0d95-4aa8-b16f-0527f45bc684 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.328161 Oct 04 08:48:09.133726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 141/259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:08 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:09.580509 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-3534f0a7-7aa9-492f-a99b-24daada850e4 req-17718218-df25-4e48-a532-ccfe07e45141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11369537-b39f-4e90-b125-51b39632ecca", "tag": "dcb83e86-4e18-40c7-ae12-720c4846ee97"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:09.599732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-3534f0a7-7aa9-492f-a99b-24daada850e4 req-17718218-df25-4e48-a532-ccfe07e45141 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:09.600304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-3534f0a7-7aa9-492f-a99b-24daada850e4 req-17718218-df25-4e48-a532-ccfe07e45141 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:09.600821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-3534f0a7-7aa9-492f-a99b-24daada850e4 req-17718218-df25-4e48-a532-ccfe07e45141 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:09.621399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-3534f0a7-7aa9-492f-a99b-24daada850e4 req-17718218-df25-4e48-a532-ccfe07e45141 service nova] Creating event network-changed:dcb83e86-4e18-40c7-ae12-720c4846ee97 for instance 11369537-b39f-4e90-b125-51b39632ecca on hv-cinder-86021 Oct 04 08:48:09.631893 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-3534f0a7-7aa9-492f-a99b-24daada850e4 req-17718218-df25-4e48-a532-ccfe07e45141 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054452 Oct 04 08:48:09.632960 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 142/260] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:48:10.143188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:10.143895 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:10.162444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:10.162924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:10.163563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:10.164434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:10.165037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:10.165609 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:10.419336 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:10.434516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-48185292-3fc2-495c-aa90-f9e9faf107f3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.295617 Oct 04 08:48:10.436704 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 143/261] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:10 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:11.463720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:11.466227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:11.469160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:11.475046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:11.475727 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:11.476382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:11.477283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:11.477941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:11.478522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:11.664978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:11.685535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-862fa65b-0079-44fc-bbe2-275bdfc5fe4a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.225092 Oct 04 08:48:11.686716 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 144/262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:11 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:12.710908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:12.711602 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:12.721537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:12.721537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:12.721902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:12.722765 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:12.723318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:12.723760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:12.962997 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:12.971688 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ff73dccc-4859-4067-a6e8-4bae7d9a570a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.264663 Oct 04 08:48:12.972457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 145/263] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:12 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:13.598999 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] validate_networks() for [('23796c7f-d7b7-4b78-a709-9c1a747eda10', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:48:13.841575 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:13.994939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:13.996260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:14.002977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:14.003825 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:14.004633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:14.005558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:14.006247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:14.006882 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:14.087886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:48:14.088305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:48:14.088770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:48:14.089173 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:48:14.089579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:48:14.101342 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:14.102176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:14.102835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:14.103809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:14.104468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:14.105369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:14.117511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=73 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:14.127986 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for project 0b7703aae5634dabb496bc221882863c. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:48:14.132527 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Getting quotas for user acf57eb971eb4f78b173a5ab47160bd1 and project 0b7703aae5634dabb496bc221882863c. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:48:14.145252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:48:14.147700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:48:14.170243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:14.178939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-121ed5f6-dcbe-4b90-8488-76aed09f150d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.187941 Oct 04 08:48:14.179500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 146/264] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:13 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:14.214107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-829e9ad2-0181-4745-90ee-720e20f1a650 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.216095 Oct 04 08:48:14.215449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 119/265] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:48:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 5218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:48:14.226670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9996dfad-b4e8-4cf2-bea6-d29269f516cb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:14.227606 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9996dfad-b4e8-4cf2-bea6-d29269f516cb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:14.373051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9996dfad-b4e8-4cf2-bea6-d29269f516cb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:14.385888 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9996dfad-b4e8-4cf2-bea6-d29269f516cb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1244 microversion: 2.1 time: 0.163145 Oct 04 08:48:14.387224 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 147/266] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:14 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1244 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:15.205132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:15.205781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:15.215117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:15.215685 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:15.216209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:15.217474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:15.218362 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:15.218926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:15.387896 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:15.396588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-14479391-fc24-4f17-8e6b-770b45294941 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.195768 Oct 04 08:48:15.397502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 120/267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:15 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:15.415819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:15.417061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:15.425486 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:15.426858 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:15.427667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:15.428667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:15.431857 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:15.432513 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:15.519203 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:15.528345 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a09e7ba0-cae9-48bc-a6eb-b4c215cd7e8a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1248 microversion: 2.1 time: 0.116691 Oct 04 08:48:15.528913 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 148/268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:15 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1248 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:16.424566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:16.425350 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:16.432115 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:16.432731 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:16.433269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:16.434221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:16.434779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:16.435302 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:16.551288 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:16.551964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:16.566767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:16.567512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:16.568934 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:16.569851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:16.570460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:16.571986 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:16.645941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:16.659457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:16.666589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-24173321-4057-4437-99fe-08d99279bab1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.241213 Oct 04 08:48:16.668516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c767bf1d-96d3-4dd4-ac92-6c83ec7281f9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1248 microversion: 2.1 time: 0.121481 Oct 04 08:48:16.669095 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 149/269] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:16 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1248 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:16.679551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 121/270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:16 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:17.696228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:17.696228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:17.700970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:17.702135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:17.713905 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:17.714702 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:17.716680 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:17.717626 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:17.719277 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:17.721177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:17.740865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:17.740865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:17.740865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:17.741954 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:17.741954 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:17.742379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:17.824426 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:17.835140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8f0bdff0-fd17-4ad9-9ede-c3800d6a5014 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1248 microversion: 2.1 time: 0.145936 Oct 04 08:48:17.835902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 150/271] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:17 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1248 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:17.973505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:17.981145 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fa488787-0560-4546-86b1-38e21184b47a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.292869 Oct 04 08:48:17.983225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 122/272] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:17 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:18.860463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:18.862854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:18.871861 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:18.880796 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:18.881653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:18.882675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:18.883622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:18.884267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:19.002312 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:19.007957 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:19.008696 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:19.011609 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f1d5c219-a14f-46d2-a85b-8be2abc60d58 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1314 microversion: 2.1 time: 0.155728 Oct 04 08:48:19.012715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 151/273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:18 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:19.026877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:19.026877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:19.026877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:19.026877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:19.027617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:19.027617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:19.185716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:19.194538 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8d0aa72a-e2f2-48fa-ad10-b0853f8f60d4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.190744 Oct 04 08:48:19.195522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 123/274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:19 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:19.410433 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0f123cdd-f242-417a-bec7-dcfe8675d685 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Action: 'create', calling method: .version_select at 0x7f5fd44f4e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-645764209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILf5ynhldbOCPLL+l0jUp+vdtSf7o+7jPOr/d+bs6pD+uydL7jEGuUJ54w8mPmt/Xc0lXakHBP0YhRxgXNg1V7xiDJw3Y2QOSu8tv+UBO5u8RpPF5PUJsnRyUbFV88hcA=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:19.427822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-0f123cdd-f242-417a-bec7-dcfe8675d685 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Getting quotas for project fe42bae7e14246d78103a4ef69457051. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:48:19.431897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-0f123cdd-f242-417a-bec7-dcfe8675d685 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Getting quotas for user 8fcf4142aa8340d692b1b3ed0aee7c87 and project fe42bae7e14246d78103a4ef69457051. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:48:19.458619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0f123cdd-f242-417a-bec7-dcfe8675d685 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052311 Oct 04 08:48:19.459219 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 152/275] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:48:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:19.592578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1706333170", "imageRef": "23c46636-0666-4734-8916-fd7d90e6ef3e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-645764209", "networks": [{"uuid": "2f3a147c-a446-40ed-beb6-ad78eab3bdec"}]}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:19.648625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] validate_networks() for [('2f3a147c-a446-40ed-beb6-ad78eab3bdec', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:48:20.039865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:20.041056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:20.048965 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:20.049463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:20.050133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:20.051029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:20.051643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:20.052232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:20.068703 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:20.092456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:48:20.093570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:48:20.094093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:48:20.094516 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:48:20.094933 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:48:20.104893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:20.105456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:20.105996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:20.106914 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:20.109374 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:20.110037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:20.132060 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Getting quotas for project fe42bae7e14246d78103a4ef69457051. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:48:20.150684 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Getting quotas for user 8fcf4142aa8340d692b1b3ed0aee7c87 and project fe42bae7e14246d78103a4ef69457051. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:48:20.162526 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:48:20.164817 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23c46636-0666-4734-8916-fd7d90e6ef3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:48:20.213760 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-54dd7b04-845d-4642-ab4b-0b4ac7e7a5a9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626253 Oct 04 08:48:20.214341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 124/276] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:48:20.225048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:20.225729 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:20.234620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:20.235110 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:20.236403 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:20.237041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:20.237711 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:20.238145 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:20.288554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:20.300840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f96a5cdc-46ce-4dcf-b825-e8a1c8df4eed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.264717 Oct 04 08:48:20.301829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 153/277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:20 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:20.308575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c9c34a5b-f1e5-4231-bfeb-275fe7768a76 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:20.309198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c9c34a5b-f1e5-4231-bfeb-275fe7768a76 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:20.395527 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:20.403943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-879ed9da-a813-4ff9-9d28-6d38a60bf4f7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.188412 Oct 04 08:48:20.404705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 125/278] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:20 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:20.417170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c9c34a5b-f1e5-4231-bfeb-275fe7768a76 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:20.424432 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c9c34a5b-f1e5-4231-bfeb-275fe7768a76 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1258 microversion: 2.1 time: 0.121217 Oct 04 08:48:20.425325 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 154/279] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:20 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1258 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:20.778701 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-213325e2-69dd-463b-9765-e8a3187369e1 req-878ef044-6758-4a4c-ab8e-3469195935fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2c9f68-135f-4233-ab6b-497b6be10b2d", "tag": "a438852b-8790-40e5-aff4-07d0c3a3ad41"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:20.789874 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-213325e2-69dd-463b-9765-e8a3187369e1 req-878ef044-6758-4a4c-ab8e-3469195935fb service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:20.791636 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-213325e2-69dd-463b-9765-e8a3187369e1 req-878ef044-6758-4a4c-ab8e-3469195935fb service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:20.792469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-213325e2-69dd-463b-9765-e8a3187369e1 req-878ef044-6758-4a4c-ab8e-3469195935fb service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:20.807830 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-213325e2-69dd-463b-9765-e8a3187369e1 req-878ef044-6758-4a4c-ab8e-3469195935fb service nova] Creating event network-changed:a438852b-8790-40e5-aff4-07d0c3a3ad41 for instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d on hv-cinder-86021 Oct 04 08:48:20.826268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-213325e2-69dd-463b-9765-e8a3187369e1 req-878ef044-6758-4a4c-ab8e-3469195935fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050669 Oct 04 08:48:20.829106 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 126/280] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:21.329067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:21.329067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:21.334639 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:21.335363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:21.335958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:21.336954 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:21.337580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:21.338211 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:21.428757 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:21.430207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:21.439534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:21.440390 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:21.441107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:21.442289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:21.442932 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:21.443524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:21.551950 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:21.581149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4e2e6e96-9540-4d7a-892a-998bc8f45339 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.258725 Oct 04 08:48:21.586037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 155/281] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:21 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:21.602503 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:21.604253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:21.618951 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:21.619439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:21.620047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:21.621114 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:21.627970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:21.628721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:21.730361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:21.738957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6d2c4998-014d-4a86-b85e-991f9289090c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1310 microversion: 2.1 time: 0.150734 Oct 04 08:48:21.739524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 156/282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:21 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:21.744463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-a510064d-d024-400e-801e-fbc02db15074 req-a9079bad-bfe5-4432-9207-6ced0c474489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11369537-b39f-4e90-b125-51b39632ecca", "name": "network-vif-plugged", "status": "completed", "tag": "dcb83e86-4e18-40c7-ae12-720c4846ee97"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:21.756107 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-a510064d-d024-400e-801e-fbc02db15074 req-a9079bad-bfe5-4432-9207-6ced0c474489 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:21.756578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-a510064d-d024-400e-801e-fbc02db15074 req-a9079bad-bfe5-4432-9207-6ced0c474489 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:21.757000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-a510064d-d024-400e-801e-fbc02db15074 req-a9079bad-bfe5-4432-9207-6ced0c474489 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:21.786449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-a510064d-d024-400e-801e-fbc02db15074 req-a9079bad-bfe5-4432-9207-6ced0c474489 service nova] Creating event network-vif-plugged:dcb83e86-4e18-40c7-ae12-720c4846ee97 for instance 11369537-b39f-4e90-b125-51b39632ecca on hv-cinder-86021 Oct 04 08:48:21.793714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-a510064d-d024-400e-801e-fbc02db15074 req-a9079bad-bfe5-4432-9207-6ced0c474489 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052203 Oct 04 08:48:21.795269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 157/283] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:21.819680 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:21.829554 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b6491d6b-6aed-440b-81e6-65ae18df7310 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.405219 Oct 04 08:48:21.831614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 127/284] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:21 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:22.604607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:22.605451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:22.611920 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:22.612396 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:22.612952 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:22.613639 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:22.614109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:22.614529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:22.746617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:22.754641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fcb98451-8d84-4f9b-8881-7d268f0e8744 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.154335 Oct 04 08:48:22.755213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 158/285] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:22 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:22.761893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:22.762502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:22.769443 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:22.770201 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:22.770693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:22.771415 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:22.771873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:22.772301 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:22.840209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:22.848333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-14f7b4d7-785c-4e38-a316-dfcc45325c4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1328 microversion: 2.1 time: 0.090476 Oct 04 08:48:22.849504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 128/286] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:22 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:22.855317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:22.855952 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:22.862229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:22.862709 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:22.863134 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:22.863815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:22.864330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:22.867594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:23.002481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:23.010034 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2459b060-9f03-4274-b6d7-d09cd14b058a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.159384 Oct 04 08:48:23.010597 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 159/287] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:22 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:23.777212 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:23.777853 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:23.784675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:23.785154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:23.785586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:23.786293 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:23.786742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:23.787161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:23.871815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:23.872419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:23.878557 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:23.879031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:23.879459 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:23.880150 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:23.880589 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:23.881002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:23.914971 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:23.922687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-dcfd4163-f215-4c0a-aab7-799a383325c2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.149298 Oct 04 08:48:23.923523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 129/288] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:23 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:23.941435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:23.949489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-56f1e300-8e1a-4284-9cb9-7872ebec139d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1328 microversion: 2.1 time: 0.081479 Oct 04 08:48:23.950093 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 160/289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:23 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1328 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:24.033188 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:24.033825 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:24.039680 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:24.040151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:24.040578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:24.041259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:24.041725 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:24.042146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:24.168859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:24.176390 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bb162621-a61c-42f2-9d6d-08c7f27cfcc7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.147642 Oct 04 08:48:24.176954 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 130/290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:24 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:24.944489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:24.945009 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:24.950986 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:24.951463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:24.951890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:24.952568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:24.953012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:24.953429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:24.977937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:24.977937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:24.984165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:24.984646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:24.985291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:24.986064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:24.986525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:24.986950 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:25.050798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:25.058787 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6ed8b423-5a90-4c2a-8d62-25cbd01b5950 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1328 microversion: 2.1 time: 0.085531 Oct 04 08:48:25.059355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 131/291] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:24 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:25.086295 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:25.094405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9338c9e4-3eb7-42bb-b13c-963c1e8939ce tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.153785 Oct 04 08:48:25.095155 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 161/292] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:24 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:25.198274 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:25.198926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:25.205061 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:25.205542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:25.205998 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:25.206684 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:25.207159 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:25.207543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:25.338188 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:25.347022 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-709ded15-c9de-4fb8-8223-529a5a660247 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.152678 Oct 04 08:48:25.347582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 132/293] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:25 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:26.083054 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:26.083671 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:26.089611 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:26.090118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:26.090545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:26.091219 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:26.091665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:26.092085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:26.116763 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:26.117405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:26.124013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:26.124501 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:26.124936 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:26.125627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:26.126117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:26.127221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:26.154046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:26.161847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a8565dea-c540-4d09-83b8-9ae99e733fd6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1328 microversion: 2.1 time: 0.083354 Oct 04 08:48:26.162411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 162/294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:26 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1328 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:26.256216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:26.263886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3fc633ef-d530-4232-823a-9ae61b2f988e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.150942 Oct 04 08:48:26.264442 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 133/295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:26 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:26.370113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:26.370672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:26.377281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:26.377787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:26.378223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:26.378910 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:26.379364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:26.379786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:26.505955 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:26.513535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-150ed9ea-5dff-41d9-a192-bbea4b41c64d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.147405 Oct 04 08:48:26.514188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 163/296] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:26 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:27.183915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:27.184525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:27.190939 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:27.192314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:27.192848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:27.193821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:27.194496 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:27.195074 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:27.275081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:27.284167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bc46aef4-481e-495e-9bbc-7335ff1db01e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1316 microversion: 2.1 time: 0.104196 Oct 04 08:48:27.285026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 134/297] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:27 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:27.302314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:27.302971 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:27.310124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:27.310823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:27.311430 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:27.312137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:27.312590 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:27.313014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:27.540254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:27.542105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:27.556119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:27.558169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:27.558973 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:27.561238 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:27.563335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:27.564598 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:27.897450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:27.911551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e436f31a-8927-4d1a-801a-68dc93feee4f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.375011 Oct 04 08:48:27.930587 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 135/298] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:27 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:27.959114 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:27.971532 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d8fc8e71-610c-4943-b54b-28ee4f97801f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.686695 Oct 04 08:48:27.973643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 164/299] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:27 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:28.314195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:28.315552 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:28.326606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:28.328695 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:28.330493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:28.334654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:28.335422 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:28.335850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:28.538300 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:28.546094 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-571dc496-4188-4d93-ac06-4eb8f047cef1 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.240003 Oct 04 08:48:28.546679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 136/300] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:28 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:28.952412 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:28.952959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:28.959755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:28.960235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:28.960661 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:28.961340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:28.961835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:28.962254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:29.012563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:29.013398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:29.023120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:29.025852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:29.030100 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:29.031095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:29.033268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:29.034008 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:29.169183 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:29.185663 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4366ab66-c130-491c-97bb-98924c3a5f42 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.237084 Oct 04 08:48:29.186335 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 165/301] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:28 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:29.231771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:29.234161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:29.241001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a789bddb-3a5d-417c-8bfe-4ecad5ac92d7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.237792 Oct 04 08:48:29.241573 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 137/302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:29 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:29.568899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:29.569546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:29.575859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:29.576370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:29.576859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:29.577623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:29.578134 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:29.578586 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:29.736926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:29.745374 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5f529698-83e3-4801-ad8f-85e9f61cdd54 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.180266 Oct 04 08:48:29.754373 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 166/303] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:29 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:30.208880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:30.209486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:30.211802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:30.212437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=18 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:30.218111 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:30.218590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:30.219016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:30.219722 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:30.220782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:30.221199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:30.263480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:30.264088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:30.270320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:30.270805 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:30.271237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:30.271927 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:30.272371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:30.272785 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:30.370416 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:30.379579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a61d1acd-5543-404f-b08e-8bf0e7638595 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.174482 Oct 04 08:48:30.394001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 138/304] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:30 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:30.411451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:30.419012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-21a25f44-8857-4263-8105-b652f4aabcd7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.159490 Oct 04 08:48:30.419579 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 167/305] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:30 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:30.768746 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:30.769351 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:30.775193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:30.775664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:30.776090 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:30.776765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:30.777208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:30.777624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:30.899470 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:30.907091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-37b41dcc-dde9-4ee2-aece-d4cf91b7a66e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.142654 Oct 04 08:48:30.908273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 139/306] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:30 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:31.404534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:31.405856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:31.413165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=14 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:31.415500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:31.416367 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:31.416860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:31.417613 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:31.418258 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:31.418732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:31.442790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:31.443407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:31.450916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:31.451685 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:31.452336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:31.453241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:31.453915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:31.454536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:31.587493 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:31.594271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:31.605163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-45ba6a4d-4eaa-4486-ae71-2d22c180f178 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.205707 Oct 04 08:48:31.607881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4f2b6f0a-8367-4093-af7c-ff3916df9afb tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.170447 Oct 04 08:48:31.608460 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 140/307] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:31 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:31.625578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 168/308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:31 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:31.930645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:31.931389 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:31.937381 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:31.937891 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:31.938822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:31.939503 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:31.939948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:31.940365 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:32.087022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:32.096337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-70d0de67-c1dc-4992-971f-f4604fb4fba9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.169678 Oct 04 08:48:32.097018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 169/309] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:31 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:32.633166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:32.633807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:32.636377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:32.637000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:32.640179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:32.640661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:32.641094 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:32.641826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:32.642279 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:32.642701 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:32.642802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:32.643287 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:32.643718 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:32.644404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:32.644860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:32.645284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:32.786949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:32.795678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-90e2be83-45a8-4f51-b100-5a5e8d18253e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.163035 Oct 04 08:48:32.797762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 170/310] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:32 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:32.802161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:32.810985 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e2c15c1a-c827-4ab6-81b9-86ec4595241e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.181670 Oct 04 08:48:32.826097 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 141/311] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:32 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:33.120168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:33.120730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:33.126717 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:33.127204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:33.127646 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:33.128338 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:33.128795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:33.129223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:33.270348 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:33.273234 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:33.280458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-38863a8d-6476-4119-bef7-77da60459099 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.164178 Oct 04 08:48:33.294142 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 171/312] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:33 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:33.821675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:33.822300 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:33.828655 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:33.829644 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:33.830121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:33.830805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:33.831276 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:33.831693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:33.834458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:33.835100 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:33.840924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:33.841411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:33.841885 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:33.842845 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:33.843296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:33.843718 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:33.972371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:33.980578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-63812263-ad3e-4425-ba60-9ea221de96c9 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.162774 Oct 04 08:48:33.981140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 142/313] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:33 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:33.992006 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:33.999737 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0cb3ed0b-594a-4b52-851a-aab295899c57 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.169100 Oct 04 08:48:34.000309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 172/314] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:33 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:34.304960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:34.305561 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:34.311524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:34.311996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:34.312428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:34.313103 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:34.313602 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:34.314049 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:34.441773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:34.450004 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-dc2f9628-1aa4-4c2a-af5a-a5c9924edf63 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.148844 Oct 04 08:48:34.450564 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 143/315] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:34 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:34.815104 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-0ebc428c-48a8-4fac-9d47-3799c0ec12bc req-3e748645-9ae0-4bda-bbc4-80c3b39ba891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2c9f68-135f-4233-ab6b-497b6be10b2d", "name": "network-vif-plugged", "status": "completed", "tag": "a438852b-8790-40e5-aff4-07d0c3a3ad41"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:34.827760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0ebc428c-48a8-4fac-9d47-3799c0ec12bc req-3e748645-9ae0-4bda-bbc4-80c3b39ba891 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:34.828315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0ebc428c-48a8-4fac-9d47-3799c0ec12bc req-3e748645-9ae0-4bda-bbc4-80c3b39ba891 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:34.828887 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0ebc428c-48a8-4fac-9d47-3799c0ec12bc req-3e748645-9ae0-4bda-bbc4-80c3b39ba891 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:34.857179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-0ebc428c-48a8-4fac-9d47-3799c0ec12bc req-3e748645-9ae0-4bda-bbc4-80c3b39ba891 service nova] Creating event network-vif-plugged:a438852b-8790-40e5-aff4-07d0c3a3ad41 for instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d on hv-cinder-86021 Oct 04 08:48:34.863199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-0ebc428c-48a8-4fac-9d47-3799c0ec12bc req-3e748645-9ae0-4bda-bbc4-80c3b39ba891 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051926 Oct 04 08:48:34.864327 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 173/316] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:35.005452 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:35.006988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:35.015276 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:35.017596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:35.018332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:35.019340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:35.020461 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:35.021064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:35.024102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:35.024797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:35.030810 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:35.031291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:35.031724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:35.032465 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:35.032914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:35.033336 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:35.153164 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:35.161420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bb998fa9-dfb2-402c-8920-7aba49edbf23 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.160889 Oct 04 08:48:35.162015 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 144/317] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:34 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:35.164734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:35.172329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e72c5362-60ec-43cb-a774-48281163eafa tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.152405 Oct 04 08:48:35.172930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 174/318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:35 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:35.473858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:35.474295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:35.480203 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:35.480715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:35.481144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:35.481862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:35.482313 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:35.482740 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:35.614915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:35.622686 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e0a8b20f-7d62-4d3c-9979-10f7b327d23a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.153869 Oct 04 08:48:35.623259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 145/319] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:35 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:36.184305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:36.184898 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:36.191762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:36.192474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:36.192915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:36.193621 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:36.194128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:36.194561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:36.194838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:36.195966 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:36.202451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:36.202928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:36.203355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:36.204072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:36.204545 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:36.204965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:36.349533 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:36.357029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d46d4851-dcb7-4bc6-90a1-67bab4377113 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.176581 Oct 04 08:48:36.357581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 175/320] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:36 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:36.369937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:36.372961 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3ea29b9f-f213-4dd4-9599-bea379a15eb9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.181818 Oct 04 08:48:36.373532 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 146/321] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:36 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:36.645790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:36.646432 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:36.652386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:36.652862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:36.653329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:36.654035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:36.654477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:36.654890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:36.802443 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:36.810206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cce910d8-439c-4662-bed0-a9cc022757e3 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.168766 Oct 04 08:48:36.810775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 176/322] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:36 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:37.381084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:37.381815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:37.388453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:37.388972 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:37.389411 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:37.390144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:37.390628 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:37.391053 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:37.395676 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:37.396296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:37.402300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:37.402784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:37.403215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:37.403906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:37.404362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:37.404789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:37.527889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:37.536137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-10c32324-d0ba-4c2e-b260-222b0369ed85 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.159143 Oct 04 08:48:37.536715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 147/323] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:37 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:37.538240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:37.545948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f67ccbb7-ba30-497b-b653-b9e7f270ad14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.154602 Oct 04 08:48:37.546575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 177/324] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:37 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:37.834903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:37.835521 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:37.841503 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:37.842099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:37.842796 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:37.843509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:37.843958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:37.844890 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:37.975400 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:37.982875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9f5fd4c2-61ed-4b99-869c-d9ef6c17da99 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.151993 Oct 04 08:48:37.983432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 148/325] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:37 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:38.559494 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:38.560102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:38.566525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:38.567114 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:38.567546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:38.568227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:38.568676 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:38.569092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:38.569193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:38.569834 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:38.576151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:38.576629 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:38.577061 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:38.577771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:38.578228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:38.578651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:38.718833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:38.728583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2933a756-d78b-4f83-9b43-1b74839b3aa0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.172975 Oct 04 08:48:38.730334 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 178/326] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:38 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:38.770754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:38.784511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6493052d-21c5-4ac7-a31b-d3ffbfa16514 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.218901 Oct 04 08:48:38.785837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 149/327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:38 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:39.014137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:39.014757 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:39.021402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:39.022150 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:39.022775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:39.024017 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:39.024349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:39.025077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:39.166800 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:39.174767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-423fa792-fa70-459a-b377-d3aa6adef39b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.164604 Oct 04 08:48:39.175332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 179/328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:39 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:39.753476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:39.754092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:39.760424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:39.760904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:39.761334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:39.762043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:39.762497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:39.762918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:39.808059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:39.808798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:39.815645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:39.816218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:39.816727 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:39.817549 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:39.818127 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:39.818642 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:39.937657 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:39.966968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-99dc961e-af21-4064-8eb3-6e888fc1ce50 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.217974 Oct 04 08:48:39.967875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 150/329] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:39 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:39.992083 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:39.999779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-dfe4a984-a94f-48f8-9cb9-19d31e012599 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.195591 Oct 04 08:48:40.000346 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 180/330] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:39 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:40.198327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:40.199043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:40.205041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:40.205520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:40.206011 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:40.206694 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:40.207143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:40.207563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:40.331542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:40.339505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-32346e41-fa4e-4e5e-baf8-25a73a7c4bdd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.145202 Oct 04 08:48:40.340066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 151/331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:40 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:40.992152 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:40.993674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:41.001092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:41.001591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:41.002104 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:41.002821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:41.003277 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:41.003739 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:41.024943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:41.026189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:41.046348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:41.047107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:41.048367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:41.049269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:41.049917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:41.050501 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:41.184399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:41.192379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e6b074ab-75e4-48d0-a76b-dc3756920787 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.205180 Oct 04 08:48:41.192954 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 181/332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:40 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:41.249491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:41.259839 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e8d71a99-7ac1-471e-adad-ac99e4dc3115 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.238606 Oct 04 08:48:41.260791 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 152/333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:41 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:41.365224 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:41.366176 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:41.372405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:41.373574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:41.374462 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:41.375724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:41.376485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:41.377071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:41.557191 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:41.567211 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4d43fb69-7977-4a17-b48c-a2f91a306726 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.206384 Oct 04 08:48:41.567897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 182/334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:41 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:42.221616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:42.222246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:42.228723 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:42.229242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:42.229679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:42.230411 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:42.230919 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:42.231341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:42.283840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:42.285263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:42.287333 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:42.292241 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:42.292722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:42.293331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:42.294048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:42.294492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:42.295186 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:42.368667 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:42.377151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-df393bae-009f-403a-8587-31589177ade4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.160107 Oct 04 08:48:42.377664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 153/335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:42 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:42.437371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:42.446000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4310f1d6-4614-4830-b74f-fe35fe2a9799 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.165866 Oct 04 08:48:42.446566 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 183/336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:42 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:42.589971 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:42.590584 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:42.592666 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:42.599357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:42.599843 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:42.600300 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:42.601490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:42.601975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:42.602402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:42.618390 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:42.736786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:42.744379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ff2197fd-704b-488d-b292-4a84d9e86ab2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.158432 Oct 04 08:48:42.744941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 154/337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:42 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:43.400284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:43.400890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:43.406745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:43.407223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:43.407654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:43.408349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:43.408807 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:43.409225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:43.469042 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:43.469801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:43.476291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:43.476782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:43.477218 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:43.477938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:43.478390 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:43.478813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:43.539228 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:43.549110 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-38c2ec5f-9017-4982-a2a6-43a2a2c9e3e3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.152594 Oct 04 08:48:43.549708 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 184/338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:43 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:43.610762 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:43.618267 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2f302a5c-2e31-4926-96cd-767ae105e85a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.153361 Oct 04 08:48:43.618829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 155/339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:43 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:43.767653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:43.768254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:43.774195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:43.774670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:43.775102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:43.775776 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:43.776223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:43.776639 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:43.903359 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:43.911528 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fc448cca-5cc1-4327-a037-5f9630407b4f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.147679 Oct 04 08:48:43.912067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 185/340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:43 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:44.572453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:44.573061 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:44.580009 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:44.580482 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:44.580911 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:44.581590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:44.582068 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:44.582487 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:44.641491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:44.642140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:44.648001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:44.648484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:44.648915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:44.649867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:44.650476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:44.650901 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:44.713886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:44.721819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-91e82e44-72ea-4125-b7b5-ebff958b004b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.153140 Oct 04 08:48:44.722396 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 156/341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:44 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:44.781526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:44.789173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-686df469-2883-4d3c-8228-a81add107fed tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.152152 Oct 04 08:48:44.789755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 186/342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:44 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:44.933978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:44.934595 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:44.941428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:44.941944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:44.942372 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:44.943190 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:44.943641 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:44.944057 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:45.069989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:45.077415 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fbb399e8-4bfb-4a3d-94da-2906d21931bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.147322 Oct 04 08:48:45.078062 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 157/343] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:44 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:45.744278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:45.744891 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:45.751502 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:45.751981 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:45.752414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:45.753096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:45.753548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:45.753996 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:45.811409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:45.812019 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:45.819020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:45.819502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:45.819935 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:45.820624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:45.821072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:45.821497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:45.884458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:45.892417 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b3fa6c60-484d-4874-8444-c59fb5ccf82e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.151913 Oct 04 08:48:45.893057 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 187/344] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:45 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:45.951478 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:45.959200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ffb101ac-96ce-4e22-9eae-2bd68691f043 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.151603 Oct 04 08:48:45.959800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 158/345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:45 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:46.100770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:46.101414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:46.107306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:46.107791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:46.108224 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:46.108911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:46.109364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:46.110421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:46.236943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:46.244541 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e5163302-83ab-4094-a424-3a3aa7d590bc tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.147673 Oct 04 08:48:46.245110 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 188/346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:46 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:46.915105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:46.915650 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:46.921987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:46.922466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:46.922893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:46.923569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:46.924013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:46.924428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:46.982084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:46.982811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:46.988804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:46.989294 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:46.989758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:46.990457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:46.990915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:46.991346 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:46.993956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:47.060581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:47.069794 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f3ca8837-c045-488c-acab-83b2b67a6b39 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.158465 Oct 04 08:48:47.070752 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 159/347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:46 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:47.129138 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:47.136978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8ec1250a-52ca-4d07-a362-311aebfdeff7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.158975 Oct 04 08:48:47.137545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 189/348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:46 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:47.267614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:47.268223 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:47.274139 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:47.274616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:47.275045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:47.275724 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:47.276168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:47.276582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:47.407241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:47.414795 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9345e73a-8cd0-48a9-aa3e-8131198911ac tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.151568 Oct 04 08:48:47.415348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 160/349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:47 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:48.092385 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:48.092999 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:48.099546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:48.100025 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:48.100460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:48.101141 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:48.101586 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:48.102030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:48.159244 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:48.159824 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:48.166273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:48.166757 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:48.167193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:48.167880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:48.168334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:48.168756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:48.232087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:48.252824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7a47ef71-b627-4206-8dee-3772acbc6923 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.164376 Oct 04 08:48:48.257178 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 190/350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:48 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:48.317168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:48.326095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cc9512b8-2b09-4c2d-ace9-05e4fb5cd421 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.171206 Oct 04 08:48:48.326774 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 161/351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:48 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:48.437285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:48.438429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:48.444388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:48.445026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:48.445481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:48.446532 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:48.447109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:48.447530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:48.658434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:48.668914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b66da38a-4b34-4e01-b484-3f07f65dc943 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.235465 Oct 04 08:48:48.669489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 191/352] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:48 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:49.062714 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-5b016c4e-296a-4c31-a809-e0f9f057c12f req-766181e0-5918-4bbd-bd3c-8210a95b4653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:49.072441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-5b016c4e-296a-4c31-a809-e0f9f057c12f req-766181e0-5918-4bbd-bd3c-8210a95b4653 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:49.072906 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-5b016c4e-296a-4c31-a809-e0f9f057c12f req-766181e0-5918-4bbd-bd3c-8210a95b4653 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:49.073327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-5b016c4e-296a-4c31-a809-e0f9f057c12f req-766181e0-5918-4bbd-bd3c-8210a95b4653 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:49.083783 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-5b016c4e-296a-4c31-a809-e0f9f057c12f req-766181e0-5918-4bbd-bd3c-8210a95b4653 service nova] Creating event network-changed:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:48:49.089383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-5b016c4e-296a-4c31-a809-e0f9f057c12f req-766181e0-5918-4bbd-bd3c-8210a95b4653 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 Oct 04 08:48:49.089999 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 162/353] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:49.290770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:49.291377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:49.297329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:49.298000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:49.298439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:49.299146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:49.299594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:49.300044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:49.350287 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:49.350986 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:49.357444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:49.357961 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:49.358397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:49.359086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:49.360040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:49.360460 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:49.429281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:49.437001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8cfdba2a-63ff-401b-aad9-b21c352d4f01 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.150192 Oct 04 08:48:49.437884 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 192/354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:49 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:49.490395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:49.498015 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-56c9b897-f466-41fb-830c-34a8c315b453 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.151900 Oct 04 08:48:49.498589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 163/355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:49 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:49.690481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:49.691118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:49.696939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:49.697415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:49.697880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:49.698580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:49.699034 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:49.699451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:49.830308 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:49.837993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0ad9c3c1-b681-4a70-9edf-46c91bf3a385 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.151306 Oct 04 08:48:49.838555 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 193/356] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:49 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:50.459716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:50.460266 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:50.466928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:50.467663 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:50.468086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:50.469339 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:50.469811 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:50.470230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:50.520319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:50.520914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:50.526784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:50.527260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:50.527688 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:50.528372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:50.528816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:50.529240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:50.599719 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:50.607819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5753b7a4-fb44-4d03-b5dd-0c5879cbc57b tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.151563 Oct 04 08:48:50.607989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 164/357] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:50 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:50.659607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:50.667347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6541e7aa-7a31-419a-981c-dd7e70ab2bfc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.151500 Oct 04 08:48:50.667984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 194/358] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:50 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:50.860928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:50.861547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:50.867770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:50.868253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:50.868689 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:50.869383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:50.869873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:50.870321 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:50.999059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:51.006689 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4fea4f54-ae11-4e09-b0f6-1c1d36fc1a55 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.150345 Oct 04 08:48:51.007248 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 165/359] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:50 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:51.629228 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:51.629864 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:51.635919 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:51.636394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:51.636818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:51.637494 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:51.637980 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:51.638399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:51.690001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:51.690606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:51.697011 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:51.697484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:51.697959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:51.698639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:51.699086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:51.699502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:51.769527 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:51.777375 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-bb794812-c06a-475c-b4c9-c7602e438651 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.151985 Oct 04 08:48:51.777969 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 195/360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:51 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:51.828930 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:51.836515 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fb11c2f7-2078-486f-a908-d57235cd60f5 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.150295 Oct 04 08:48:51.837067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 166/361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:51 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:52.029709 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:52.030338 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:52.036098 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:52.036575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:52.037002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:52.037679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:52.038145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:52.038563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:52.210874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:52.218137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cac9fe76-c208-4e0b-bcb1-3fcc59fa9828 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.192228 Oct 04 08:48:52.218930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 196/362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:52 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:52.800458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:52.801074 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:52.807505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:52.807984 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:52.808418 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:52.809105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:52.809559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:52.810010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:52.860349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:52.860990 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:52.866890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:52.868238 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:52.868669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:52.869360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:52.869835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:52.870259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:52.940294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:52.948070 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c8fd00b8-4176-44b2-a6c8-13064d7f525f tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1314 microversion: 2.1 time: 0.152120 Oct 04 08:48:52.948646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 167/363] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:52 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:52.996188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:53.004339 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-78e5c72f-357b-4dc3-a5c5-5326af7c723e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.148552 Oct 04 08:48:53.005183 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 197/364] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:52 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:53.244893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:53.245439 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:53.251410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:53.251891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:53.252324 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:53.253011 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:53.253464 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:53.253926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:53.380910 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:53.388536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6e901224-f7ee-404b-a420-9f52f693815c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.147521 Oct 04 08:48:53.389089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 168/365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:53 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:53.971026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:53.971557 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:53.977503 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:53.978016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:53.978454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:53.979140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:53.979592 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:53.980018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.027636 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:54.028344 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:54.035401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.035976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.036410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.037089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.037533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.037970 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.117106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:54.125123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1017f04a-8083-4ab5-9492-19996252c163 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1499 microversion: 2.1 time: 0.158910 Oct 04 08:48:54.126064 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 198/366] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:53 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:54.190889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:54.200760 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1af0bd2c-9687-4681-9be8-d258bc1dc77f tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1370 microversion: 2.1 time: 0.176887 Oct 04 08:48:54.201348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 169/367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:54 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:54.411334 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:54.412171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:54.418421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.418911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.419346 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.420043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.420920 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.421354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.750072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:54.750727 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:54.757656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.758187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.758626 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.759335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.759822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.760245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.772375 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:54.780745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-772b4b74-8504-4e10-b60d-35cc77271aab tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.373210 Oct 04 08:48:54.781728 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 199/368] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:54 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:54.808548 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:48:54.842509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:54.891486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e837f3f1-efdb-4629-ad82-0e8e39b0ee64 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 204 len: 0 microversion: 2.1 time: 0.145172 Oct 04 08:48:54.892092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 170/369] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:48:54 2022] DELETE /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:48:54.900287 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:54.900894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:54.906810 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.907292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.907733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:54.908415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:54.908868 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:54.909285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:55.039021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:55.046839 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-15ae9253-7e89-4a89-8aef-3cc0518a4207 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1505 microversion: 2.1 time: 0.150377 Oct 04 08:48:55.047401 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 200/370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:54 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:55.224755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:55.225458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:55.232239 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:55.232724 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:55.233221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:55.233993 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:55.234455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:55.234874 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:55.374951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:55.382807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-401f6b71-315c-4e6a-ba0a-1d7b2b1b8b3a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1564 microversion: 2.1 time: 0.162278 Oct 04 08:48:55.383418 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 171/371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:55 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:55.405002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:55.405496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:55.412127 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:55.412610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:55.413048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:55.413796 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:55.414250 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:55.414674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:55.489924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f8544e99-e71f-4ab6-9606-7645ce64683a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088697 Oct 04 08:48:55.490518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 201/372] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 08:48:55 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:55.811489 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:55.812792 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:55.822083 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:55.822833 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:55.823431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:55.824391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:55.825193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:55.825874 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:55.986787 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:55.995134 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c7e329c6-da5a-4bfa-a7ea-fc38f5fa7a30 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.193113 Oct 04 08:48:55.995805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 172/373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:55 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:56.070355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:56.070967 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:56.076959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:56.077442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:56.077925 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:56.078614 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:56.079065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:56.079489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:56.501346 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:56.509776 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-37cd29fc-4052-4a85-a096-c6a3165ef2e6 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1505 microversion: 2.1 time: 0.443331 Oct 04 08:48:56.510354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 202/374] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:56 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:56.762927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-45f34703-61fd-4a75-b69f-17e06ba6f611 req-4892bed4-8a2c-45b2-99ba-83b74dedc483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2c9f68-135f-4233-ab6b-497b6be10b2d", "tag": "a438852b-8790-40e5-aff4-07d0c3a3ad41"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:56.773290 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-45f34703-61fd-4a75-b69f-17e06ba6f611 req-4892bed4-8a2c-45b2-99ba-83b74dedc483 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:56.773786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-45f34703-61fd-4a75-b69f-17e06ba6f611 req-4892bed4-8a2c-45b2-99ba-83b74dedc483 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:56.774211 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-45f34703-61fd-4a75-b69f-17e06ba6f611 req-4892bed4-8a2c-45b2-99ba-83b74dedc483 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:56.785264 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-45f34703-61fd-4a75-b69f-17e06ba6f611 req-4892bed4-8a2c-45b2-99ba-83b74dedc483 service nova] Creating event network-changed:a438852b-8790-40e5-aff4-07d0c3a3ad41 for instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d on hv-cinder-86021 Oct 04 08:48:56.790106 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-45f34703-61fd-4a75-b69f-17e06ba6f611 req-4892bed4-8a2c-45b2-99ba-83b74dedc483 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030777 Oct 04 08:48:56.790686 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 173/375] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:57.018838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:57.019474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:57.028422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:57.028992 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:57.032435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:57.032435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:57.032435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:57.032866 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:57.230869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:57.240189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-44985f11-37c3-4d0c-a672-cf5bce3674e9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.225285 Oct 04 08:48:57.241063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 203/376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:57 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:48:57.535756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:57.536922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:57.548542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:57.549287 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:57.549734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:57.550540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:57.551404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:57.552262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:57.857311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:57.866013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-098ea270-8729-4d85-911d-563eeeb30771 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1505 microversion: 2.1 time: 0.335107 Oct 04 08:48:57.867175 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 174/377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:57 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:58.263625 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:58.264758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:58.273931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:58.274661 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:58.275283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:58.276230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:58.276842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:58.277506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:58.609299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:58.617450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e1bd4815-5c71-4a38-8cbb-1cd58b1a40b0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.358268 Oct 04 08:48:58.618048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 204/378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:58 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:58.805375 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-922cc544-c1ae-45fa-a375-9fd596e39ab6 req-38491d8d-f152-45e4-a8f8-b6649ed74ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11369537-b39f-4e90-b125-51b39632ecca", "name": "network-vif-deleted", "tag": "dcb83e86-4e18-40c7-ae12-720c4846ee97"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:48:58.815912 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-922cc544-c1ae-45fa-a375-9fd596e39ab6 req-38491d8d-f152-45e4-a8f8-b6649ed74ba4 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:58.816416 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-922cc544-c1ae-45fa-a375-9fd596e39ab6 req-38491d8d-f152-45e4-a8f8-b6649ed74ba4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:58.816847 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-922cc544-c1ae-45fa-a375-9fd596e39ab6 req-38491d8d-f152-45e4-a8f8-b6649ed74ba4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:58.827730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-922cc544-c1ae-45fa-a375-9fd596e39ab6 req-38491d8d-f152-45e4-a8f8-b6649ed74ba4 service nova] Creating event network-vif-deleted:dcb83e86-4e18-40c7-ae12-720c4846ee97 for instance 11369537-b39f-4e90-b125-51b39632ecca on hv-cinder-86021 Oct 04 08:48:58.832270 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-922cc544-c1ae-45fa-a375-9fd596e39ab6 req-38491d8d-f152-45e4-a8f8-b6649ed74ba4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030613 Oct 04 08:48:58.832838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 175/379] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:48:58.890304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:58.890842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:58.896653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:58.897123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:58.897548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:58.898371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:58.898861 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:58.899260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:58.930624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:58.931197 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:58.931632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:58.932105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lazy-loading 'fault' on Instance uuid 11369537-b39f-4e90-b125-51b39632ecca {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:48:58.977984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:58.980257 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:58.987710 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5b259610-31f7-4dee-be5f-836829fe8146 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1304 microversion: 2.1 time: 0.101288 Oct 04 08:48:58.988267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 205/380] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:58 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:48:59.641170 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:48:59.641816 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:48:59.647742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:59.653185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:59.653185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:59.653185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:48:59.653185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:48:59.653593 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:48:59.817624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:48:59.825399 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0b54b068-26c5-4a85-880f-da52a9072358 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.188715 Oct 04 08:48:59.826083 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 176/381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:48:59 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:00.009854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:00.011032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:00.017670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:00.018198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:00.018633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:00.019335 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:00.019791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:00.020215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:00.058480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:00.058978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:00.059411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:00.059869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lazy-loading 'fault' on Instance uuid 11369537-b39f-4e90-b125-51b39632ecca {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:49:00.112633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:00.120817 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-75907ed7-6b2b-41cb-ad06-d6f1c0c4334e tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1304 microversion: 2.1 time: 0.114811 Oct 04 08:49:00.121852 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 206/382] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:00 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:00.850743 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:00.851450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:00.859524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:00.860006 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:00.860433 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:00.861124 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:00.861570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:00.862011 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:01.043277 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:01.052697 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a053039a-9724-4beb-b4f9-195cbcc15760 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.206474 Oct 04 08:49:01.053381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 177/383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:00 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:01.145735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:01.146664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:01.152990 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:01.153500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:01.154137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:01.154834 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:01.155285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:01.156442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:01.188600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:01.189003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:01.189436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:01.189934 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lazy-loading 'fault' on Instance uuid 11369537-b39f-4e90-b125-51b39632ecca {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:49:01.233468 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:01.243464 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c84bf293-f241-4d32-84de-f7f13a8915db tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1304 microversion: 2.1 time: 0.102714 Oct 04 08:49:01.244124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 207/384] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:01 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:02.081360 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:02.084001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:02.095366 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:02.096123 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:02.096762 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:02.098346 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:02.099352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:02.100252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:02.269639 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:02.270384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:02.276817 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:02.278087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:02.278792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:02.279730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:02.280415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:02.281150 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:02.336441 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:02.337664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:02.338591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:02.339351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lazy-loading 'fault' on Instance uuid 11369537-b39f-4e90-b125-51b39632ecca {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:49:02.402943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:02.415893 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-042fba82-af34-4e0d-af7e-72d94f487c13 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1304 microversion: 2.1 time: 0.152406 Oct 04 08:49:02.416628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 208/385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:02 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:49:02.580547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:02.588645 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d89eee83-52a0-4cc4-8fc0-2667cd02710f tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.516056 Oct 04 08:49:02.589217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 178/386] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:02 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:03.441264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:03.442080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:03.449569 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:03.450340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:03.450940 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:03.455416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:03.456319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:03.456770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:03.492908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:03.493466 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:03.494005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:03.494538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lazy-loading 'fault' on Instance uuid 11369537-b39f-4e90-b125-51b39632ecca {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:49:03.539210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:03.555556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0874f50f-6a76-4d80-a95b-9ad7b3cd4542 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 200 len: 1304 microversion: 2.1 time: 0.118085 Oct 04 08:49:03.556160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 209/387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:03 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:03.613800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:03.614467 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:03.621263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:03.622480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:03.622918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:03.623665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:03.624108 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:03.624587 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:04.001375 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:04.013143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-15463ab7-1465-4ca3-a5c2-22ff2d1084a0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.403790 Oct 04 08:49:04.018547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 179/388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:03 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:04.579849 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:04.581352 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 11369537-b39f-4e90-b125-51b39632ecca] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:04.587841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:04.588577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:04.589173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:04.590064 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:04.590672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:04.591269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:04.606657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] HTTP exception thrown: Instance 11369537-b39f-4e90-b125-51b39632ecca could not be found. Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Request method failure captured: Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca HTTP/1.1 Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_NADGyKIt9kF3IQh1cC-WLtxbWK5kRD4Kv-ZilzWrnqAm33n_sxiFaO4j79azrToDlf5_SuThFZg5la_QjTDRgKmekMM_dwyt6MLwQW1vuaNwjQvcoXqhvhlQ5XHe7rpu4KL2iE8nAvCZcfu0lWrzH3j_D4jFuauGILPJcJBJGYdvM Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 47f943270eaa45a4b5aec895741d553d Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesActionsTest-1682473865 Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:49:04.609169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f943270eaa45a4b5aec895741d553d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f943270eaa45a4b5aec895741d553d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f943270eaa45a4b5aec895741d553d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f943270eaa45a4b5aec895741d553d"}]}] Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesActionsTest-1682473865 Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 47f943270eaa45a4b5aec895741d553d Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesActionsTest-1682473865 Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesActionsTest-1682473865-project Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: efea00dacdca4d1d8e919fb446e164ea Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesActionsTest-1682473865-project Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 11369537-b39f-4e90-b125-51b39632ecca could not be found. Oct 04 08:49:04.610633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '11369537-b39f-4e90-b125-51b39632ecca'} Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11369537-b39f-4e90-b125-51b39632ecca could not be found. Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:49:04.611421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11369537-b39f-4e90-b125-51b39632ecca could not be found. Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11369537-b39f-4e90-b125-51b39632ecca could not be found. Oct 04 08:49:04.612638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:04.615100 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Returning 404 to user: Instance 11369537-b39f-4e90-b125-51b39632ecca could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:49:04.616194 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d6c8219a-7fd7-4589-b17c-28357a2f71d5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca" status: 404 len: 111 microversion: 2.1 time: 0.041039 Oct 04 08:49:04.616953 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 210/389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:04 2022] GET /compute/v2.1/servers/11369537-b39f-4e90-b125-51b39632ecca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:49:04.783221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-446385820", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "networks": [{"uuid": "b2c6ee9e-c46f-4eab-9634-c27c98795f15"}]}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:04.887102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] validate_networks() for [('b2c6ee9e-c46f-4eab-9634-c27c98795f15', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:49:05.034944 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-5daa0b88-6eb6-454c-aaad-171f385c01e6 req-7ba7d5fe-07e4-4425-9735-37351f082e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "name": "network-vif-plugged", "status": "completed", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:05.055961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5daa0b88-6eb6-454c-aaad-171f385c01e6 req-7ba7d5fe-07e4-4425-9735-37351f082e99 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:05.056866 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5daa0b88-6eb6-454c-aaad-171f385c01e6 req-7ba7d5fe-07e4-4425-9735-37351f082e99 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:05.057655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5daa0b88-6eb6-454c-aaad-171f385c01e6 req-7ba7d5fe-07e4-4425-9735-37351f082e99 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:05.081928 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-5daa0b88-6eb6-454c-aaad-171f385c01e6 req-7ba7d5fe-07e4-4425-9735-37351f082e99 service nova] Creating event network-vif-plugged:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:49:05.087961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-5daa0b88-6eb6-454c-aaad-171f385c01e6 req-7ba7d5fe-07e4-4425-9735-37351f082e99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057550 Oct 04 08:49:05.089727 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 211/390] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:49:05.097499 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:05.098223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:05.106896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:05.112553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:05.113180 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:05.114112 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:05.114715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:05.115300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:05.307181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:05.315947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fe9687b9-dcd2-49b8-8199-a8c1107fb782 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.223386 Oct 04 08:49:05.316794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 212/391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:05 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:05.679103 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:49:05.679779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:49:05.687409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:49:05.688062 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:49:05.691158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:49:05.714273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:05.715087 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:05.716590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:05.719263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:05.719992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:05.721455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:05.762552 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Getting quotas for project 47f943270eaa45a4b5aec895741d553d. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:49:05.767468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Getting quotas for user efea00dacdca4d1d8e919fb446e164ea and project 47f943270eaa45a4b5aec895741d553d. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:49:05.782201 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:49:05.784943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:49:05.843531 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1fc17726-8ca4-45db-9f68-2c6cae897fa7 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064548 Oct 04 08:49:05.844922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 180/392] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:49:05.856892 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e773e556-ffa5-491e-b84c-676a17412e7d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:05.858307 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e773e556-ffa5-491e-b84c-676a17412e7d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:05.955788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e773e556-ffa5-491e-b84c-676a17412e7d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:05.963412 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e773e556-ffa5-491e-b84c-676a17412e7d tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1213 microversion: 2.1 time: 0.111024 Oct 04 08:49:05.964296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 213/393] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:05 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:06.342998 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:06.344052 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:06.357372 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:06.358196 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:06.359659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:06.360868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:06.361833 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:06.362676 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:06.566083 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:06.575033 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e40128f0-e2bb-4f26-b077-fdeafc9b9771 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1358 microversion: 2.1 time: 0.238002 Oct 04 08:49:06.586191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 181/394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:06 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:06.987738 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:06.988512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:06.998443 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:06.998966 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:07.005422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:07.006219 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:07.006682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:07.007112 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:07.112760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:07.122114 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-843a00bf-3be8-4850-8547-1eff13eee8e0 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1265 microversion: 2.1 time: 0.139000 Oct 04 08:49:07.122968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 214/395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:06 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:07.599111 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:07.600338 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:07.607623 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:07.608106 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:07.609069 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:07.610014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:07.610458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:07.611053 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.150047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:08.151901 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:08.163195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.164133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.164758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.165480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.165955 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.166379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.172751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:08.181842 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a2ac9739-4de0-4ef0-b016-a918f290b1c2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1548 microversion: 2.1 time: 0.586666 Oct 04 08:49:08.183424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 182/396] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:07 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1548 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:08.222227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:08.224447 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:08.241234 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.245311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.248810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.249921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.252581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.253274 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.285063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:08.300288 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2ab67f42-e6bd-468b-8338-44dcb80a6db5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1265 microversion: 2.1 time: 0.153135 Oct 04 08:49:08.302122 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 215/397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:08 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:08.537895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:08.550451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bb29f3b7-2aed-4f91-8368-f6bd3a63bd95 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1548 microversion: 2.1 time: 0.339139 Oct 04 08:49:08.551375 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 183/398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:08 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1548 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:08.572961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:08.579265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:08.580119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Searching by: {'deleted': False, 'project_id': 'fe42bae7e14246d78103a4ef69457051'} {{(pid=126938) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 08:49:08.590544 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.591458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.592426 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.594036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.594829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.595269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.732056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.multi_cell_list [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126938) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 08:49:08.886857 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ba328dcb-d1f6-48d2-914d-18e9bbf5766e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.317867 Oct 04 08:49:08.887863 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 216/399] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 4 08:49:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:08.904802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:08.906054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:08.929736 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.930192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.930630 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:08.931806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:08.932935 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:08.939847 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:09.188431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:09.200510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ef3fe933-0f7d-4541-885f-847cf4b2fdfd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1548 microversion: 2.1 time: 0.304063 Oct 04 08:49:09.217397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 184/400] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:08 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1548 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:09.324491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:09.325627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:09.339108 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:09.340800 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:09.346877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:09.353799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:09.354300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:09.354756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:09.533493 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:09.543627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-189bdf32-4cd0-4eda-8bc7-e015178a1279 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1271 microversion: 2.1 time: 0.223130 Oct 04 08:49:09.564225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 217/401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:09 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:10.576440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:10.577585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:10.586099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:10.586860 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:10.587477 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:10.588365 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:10.588999 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:10.589797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:10.929441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:10.939309 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-75a62ea1-2e80-403e-8d48-2335f292be47 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.371777 Oct 04 08:49:10.950402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 185/402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:10 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:11.463877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-8b92c3c9-953e-4eb3-bded-f8286f3678f1 req-54a5502a-f126-44db-9695-a543b67eaf97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0a9571-1186-4f66-bcb7-70c461bf339a", "tag": "80c220c6-18bd-4f84-bc8c-3205e99a91a5"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:11.486612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-8b92c3c9-953e-4eb3-bded-f8286f3678f1 req-54a5502a-f126-44db-9695-a543b67eaf97 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:11.487723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-8b92c3c9-953e-4eb3-bded-f8286f3678f1 req-54a5502a-f126-44db-9695-a543b67eaf97 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:11.489475 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-8b92c3c9-953e-4eb3-bded-f8286f3678f1 req-54a5502a-f126-44db-9695-a543b67eaf97 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:11.524819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-8b92c3c9-953e-4eb3-bded-f8286f3678f1 req-54a5502a-f126-44db-9695-a543b67eaf97 service nova] Creating event network-changed:80c220c6-18bd-4f84-bc8c-3205e99a91a5 for instance 0d0a9571-1186-4f66-bcb7-70c461bf339a on hv-cinder-86021 Oct 04 08:49:11.532361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-8b92c3c9-953e-4eb3-bded-f8286f3678f1 req-54a5502a-f126-44db-9695-a543b67eaf97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076386 Oct 04 08:49:11.538381 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 218/403] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:11.966841 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:11.968468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:11.975090 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:11.975826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:11.976436 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:11.981046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:11.981982 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:11.983081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:12.227171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5c2c77d-15b3-4c3e-af39-6104795aacb8"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:12.229773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:12.239332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:12.239975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:12.240616 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:12.242490 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:12.246229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:12.246729 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:12.574249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:12.587005 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2ac6722c-e8f2-450e-a473-dd22e99ae8e8 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.625144 Oct 04 08:49:12.587595 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 186/404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:11 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:13.123979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c906b6b4-d9b1-4380-bcae-61e0de9ae9b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Action: 'create', calling method: .version_select at 0x7f5fd45a5310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-322513154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbdUYYjKaswkrxFvlSf+InZt4DuzIlk72Tgy8nHsRXCcKRrq7K7z6YTxov4JiS5gXb7jcTymLOpo+9IY3VIzgWNPyCOSXGYLMeCZKWxLBhM5lpXHmMPe6a37wuBw3ISgg=="}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:13.129482 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:13.147871 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-c906b6b4-d9b1-4380-bcae-61e0de9ae9b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:49:13.152055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-c906b6b4-d9b1-4380-bcae-61e0de9ae9b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for user f928852d90b94ac5979e4a7806896b7a and project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:49:13.204065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c906b6b4-d9b1-4380-bcae-61e0de9ae9b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.255022 Oct 04 08:49:13.204661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 187/405] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:49:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:49:13.611122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:13.611903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:13.618718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:13.619395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:13.619914 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:13.620789 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:13.621415 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:13.621868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:13.770092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:13.778911 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2f1e7c37-e201-43bf-b22c-4c6067474e32 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.172829 Oct 04 08:49:13.780431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 188/406] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:13 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:49:14.809013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:14.809632 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:14.818606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:14.819468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:14.820286 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:14.821055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:14.821510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:14.822069 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:14.955961 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:14.958270 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:14.965216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-284e28e5-610c-46b6-92b4-5b0c34d021a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.165659 Oct 04 08:49:14.966025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 189/407] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:14 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:15.883561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5ef66864-32fd-4aa6-b753-f51f2c2d8159 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.660825 Oct 04 08:49:15.885658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 219/408] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:49:12 2022] POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments => generated 194 bytes in 3664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:15.989098 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:15.989735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:15.991500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:16.006263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:16.006974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:16.007712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:16.008467 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:16.008922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:16.009533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:16.155710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:16.170967 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-89733dd2-9db6-4186-9630-965f13676263 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.186492 Oct 04 08:49:16.172831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 190/409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:15 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:17.196860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:17.197557 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:17.199930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:17.200619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=86 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:17.208051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:17.208534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:17.208970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:17.209660 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:17.210137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:17.210559 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:17.343693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:17.351462 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-dc6d0651-1110-4539-90bc-7062c8a6a63a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.158767 Oct 04 08:49:17.352027 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 220/410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:17 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:18.374437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:18.375263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:18.381619 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:18.382133 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:18.382607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:18.383301 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:18.383748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:18.384170 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:18.519224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:18.526751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4957b005-1453-4500-9f1d-6a33124c5205 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.156756 Oct 04 08:49:18.527310 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 191/411] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:18 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:19.254770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-9c37cae9-714f-4a2e-aa65-3c5639b22eef req-51c582c2-2ed5-45c1-9343-e9e5f11e5ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0a9571-1186-4f66-bcb7-70c461bf339a", "name": "network-vif-plugged", "status": "completed", "tag": "80c220c6-18bd-4f84-bc8c-3205e99a91a5"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:19.260163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:19.266327 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-9c37cae9-714f-4a2e-aa65-3c5639b22eef req-51c582c2-2ed5-45c1-9343-e9e5f11e5ac0 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:19.266810 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-9c37cae9-714f-4a2e-aa65-3c5639b22eef req-51c582c2-2ed5-45c1-9343-e9e5f11e5ac0 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:19.267248 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-9c37cae9-714f-4a2e-aa65-3c5639b22eef req-51c582c2-2ed5-45c1-9343-e9e5f11e5ac0 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:19.279371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-9c37cae9-714f-4a2e-aa65-3c5639b22eef req-51c582c2-2ed5-45c1-9343-e9e5f11e5ac0 service nova] Creating event network-vif-plugged:80c220c6-18bd-4f84-bc8c-3205e99a91a5 for instance 0d0a9571-1186-4f66-bcb7-70c461bf339a on hv-cinder-86021 Oct 04 08:49:19.284843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-9c37cae9-714f-4a2e-aa65-3c5639b22eef req-51c582c2-2ed5-45c1-9343-e9e5f11e5ac0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033809 Oct 04 08:49:19.285636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 221/412] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:19.550773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:19.551463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:19.557939 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:19.558434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:19.558872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:19.559578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:19.560209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:19.560809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:19.696339 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:19.704123 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ca936b1f-555c-4994-939b-af3feb7816a1 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.157413 Oct 04 08:49:19.704687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 192/413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:19 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:20.727610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:20.728312 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:20.735137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:20.735623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:20.736061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:20.736786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:20.737244 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:20.737669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:20.866552 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:20.874789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a2ce09dd-82ee-469f-ba0f-b77ae88c7d58 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.151861 Oct 04 08:49:20.875543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 222/414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:20 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:21.897753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:21.898380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:21.905646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:21.906197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:21.906784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:21.907455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:21.907937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:21.908383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:22.043991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:22.051958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c5335b26-9f87-4a7a-ad6c-008558e4eba3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1313 microversion: 2.1 time: 0.158072 Oct 04 08:49:22.052613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 193/415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:21 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:22.598698 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:22.599430 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:22.605978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:22.606462 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:22.606889 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:22.608079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:22.608523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:22.608938 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:22.611476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:22.636031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7702e7d9-92e9-4608-a3fa-b513d8f056e7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/ips" status: 200 len: 150 microversion: 2.20 time: 0.041243 Oct 04 08:49:22.636585 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 223/416] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Oct 4 08:49:22 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:49:23.077280 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:23.078041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:23.084391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:23.084873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:23.085331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:23.086063 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:23.086520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:23.086941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:23.172160 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=10 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:23.220686 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:23.228444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e8751a17-a266-42ff-9a2e-790ac321baf5 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1497 microversion: 2.1 time: 0.155834 Oct 04 08:49:23.229002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 194/417] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:23 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:24.570502 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:24.571160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:24.573448 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 08:49:24.573590 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Tue Oct 4 08:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 (ip 10.222.0.26) !!! Oct 04 08:49:24.582340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:24.582819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:24.583251 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:24.583936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:24.584379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:24.584792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:24.719461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:24.729292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b8c3a77b-c53d-4e99-8028-b31f473816ed tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1594 microversion: 2.1 time: 0.162436 Oct 04 08:49:24.729802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 224/418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:24 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:24.821512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:24.822120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:24.829242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:24.829835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:24.830506 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:24.831228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:24.831788 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:24.832108 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:24.859000 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:49:24.933382 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-213d7c54-eabd-4e13-b701-5cde280c68ad tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 204 len: 0 microversion: 2.1 time: 0.115342 Oct 04 08:49:24.937997 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 195/419] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:49:24 2022] DELETE /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:49:24.943260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:24.943899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:24.950626 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:24.951303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:24.951749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:24.952537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:24.952994 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:24.953423 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:25.158500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:25.166315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d971cf94-2fdf-4dea-911b-bf15a672d85a tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1503 microversion: 2.1 time: 0.227214 Oct 04 08:49:25.166977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 225/420] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:24 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:25.709713 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:25.710359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:25.716944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:25.717491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:25.717976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:25.718655 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:25.719450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:25.719885 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:25.746320 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lazy-loading 'flavor' on Instance uuid d2c490e2-0104-4fcb-b255-1f1c8b41c083 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:49:26.009949 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-97ce4c46-956f-4147-8298-1c85736ef176 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/action" status: 202 len: 0 microversion: 2.20 time: 0.304387 Oct 04 08:49:26.010751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 196/421] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 08:49:25 2022] POST /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:49:26.020142 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:26.020958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:26.033082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:26.033082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:26.033082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:26.033082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:26.033562 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:26.034254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:26.191986 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:26.192687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:26.199031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:26.199509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:26.200031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:26.200715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:26.201700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:26.202172 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:26.286243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:26.294888 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:26.296614 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:26.297924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-30ea7ab5-d603-4e16-9339-b769691caa54 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.282739 Oct 04 08:49:26.298718 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 226/422] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:26 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:49:26.345516 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:26.353670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ad834aa7-32d3-4c2b-a5be-ecfe602e2105 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1503 microversion: 2.1 time: 0.166171 Oct 04 08:49:26.365711 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 197/423] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:26 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:49:26.733319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:26.734087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:26.740490 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:26.740974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:26.741428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:26.742236 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:26.742685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:26.743105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:26.769634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-61547c60-1637-4e17-acff-0b43a4242132 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/ips" status: 200 len: 150 microversion: 2.1 time: 0.040168 Oct 04 08:49:26.770242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 227/424] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:49:26 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:26.981721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-c62893d7-ca30-4d26-94ab-fcbcad4e66be req-b2d8496d-dc3d-4730-9ecb-1f2d0047a878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:27.001415 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c62893d7-ca30-4d26-94ab-fcbcad4e66be req-b2d8496d-dc3d-4730-9ecb-1f2d0047a878 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:27.004442 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c62893d7-ca30-4d26-94ab-fcbcad4e66be req-b2d8496d-dc3d-4730-9ecb-1f2d0047a878 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:27.004957 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c62893d7-ca30-4d26-94ab-fcbcad4e66be req-b2d8496d-dc3d-4730-9ecb-1f2d0047a878 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:27.031675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-c62893d7-ca30-4d26-94ab-fcbcad4e66be req-b2d8496d-dc3d-4730-9ecb-1f2d0047a878 service nova] Creating event network-changed:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:49:27.039943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-c62893d7-ca30-4d26-94ab-fcbcad4e66be req-b2d8496d-dc3d-4730-9ecb-1f2d0047a878 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064972 Oct 04 08:49:27.041357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 198/425] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:27.325490 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:27.326128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:27.334274 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:27.334839 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:27.335380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:27.336091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:27.337021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:27.337620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:27.378121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:27.378826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:27.385204 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:27.385710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:27.386325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:27.387026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:27.387479 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:27.387897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:27.547991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:27.558339 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-67742a51-311d-4925-8653-77cad0ea07d3 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1503 microversion: 2.1 time: 0.184386 Oct 04 08:49:27.560173 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 199/426] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:27 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:49:27.568953 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:27.588841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:27.590486 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:27.594984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c0ea9386-6438-4af2-8eb5-1c1f458f8340 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.274373 Oct 04 08:49:27.595596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 228/427] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:27 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:28.223903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c35f4d4-d4f7-4085-901c-6666f30e16df"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:28.226199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:28.233576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.234562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.235200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.236097 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.236713 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.237298 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.417742 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1559726120"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:28.418365 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:28.425377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.426183 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.426711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.427659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.428350 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.428979 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.593609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cc001e17-a009-48c4-82f3-e9ecc410914c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373488 Oct 04 08:49:28.595089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 200/428] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:49:28 2022] POST /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:49:28.601732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:28.602877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:28.614326 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.614868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.615494 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.618462 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.619028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.619511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.739838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:28.755166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d9d3cc84-cb55-4e82-9ad9-110cd8db84cd tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1461 microversion: 2.1 time: 0.158469 Oct 04 08:49:28.756101 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 201/429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:28 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1461 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:28.760820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:28.761634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:28.767806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.768153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.768579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.769261 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:28.769723 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:28.770148 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:28.770545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.network.security_group_api [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Adding security group 437e075f-e7ee-443c-89af-7e0dace25892 to port 1d1a1b46-d12b-479d-9c8f-be2338ac1d4e Oct 04 08:49:28.773048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:28.928543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:28.937149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:28.938690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:28.939880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6e9d07fc-fec2-460e-9f11-1f1c9667c2e5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.182854 Oct 04 08:49:28.940433 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 202/430] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:28 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:29.059533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-e3e942e0-f3b8-4b44-8b05-3628ff4412b3 req-cc162e7c-be37-498d-b168-429d4a49fd6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0a9571-1186-4f66-bcb7-70c461bf339a", "name": "network-vif-deleted", "tag": "80c220c6-18bd-4f84-bc8c-3205e99a91a5"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:29.069964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e3e942e0-f3b8-4b44-8b05-3628ff4412b3 req-cc162e7c-be37-498d-b168-429d4a49fd6e service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.070449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e3e942e0-f3b8-4b44-8b05-3628ff4412b3 req-cc162e7c-be37-498d-b168-429d4a49fd6e service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.070879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e3e942e0-f3b8-4b44-8b05-3628ff4412b3 req-cc162e7c-be37-498d-b168-429d4a49fd6e service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:29.083340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-e3e942e0-f3b8-4b44-8b05-3628ff4412b3 req-cc162e7c-be37-498d-b168-429d4a49fd6e service nova] Creating event network-vif-deleted:80c220c6-18bd-4f84-bc8c-3205e99a91a5 for instance 0d0a9571-1186-4f66-bcb7-70c461bf339a on hv-cinder-86021 Oct 04 08:49:29.088809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-e3e942e0-f3b8-4b44-8b05-3628ff4412b3 req-cc162e7c-be37-498d-b168-429d4a49fd6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Oct 04 08:49:29.089413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 203/431] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:49:29.219300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9efc134a-813a-4fb5-afcf-1604fd308ca5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/action" status: 202 len: 0 microversion: 2.1 time: 0.802818 Oct 04 08:49:29.219300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 229/432] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:49:28 2022] POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:49:29.227987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:29.228685 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:29.235492 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.236397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.237036 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:29.238059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.238786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.239311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:29.395240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:29.404009 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ba2effaa-ed24-433c-a1e2-75ea50851c6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1760 microversion: 2.1 time: 0.180683 Oct 04 08:49:29.405189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 204/433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:29 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:29.781235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:29.782022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:29.788984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.790684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.791179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:29.791887 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.792516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.792979 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:29.831545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.832395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.833103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:29.833775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lazy-loading 'fault' on Instance uuid 0d0a9571-1186-4f66-bcb7-70c461bf339a {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:49:29.884545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efea00dacdca4d1d8e919fb446e164ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f943270eaa45a4b5aec895741d553d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:29.891961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4cdf0616-805d-4905-816e-fb8e7579ecf4 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 200 len: 1303 microversion: 2.1 time: 0.116447 Oct 04 08:49:29.892567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 230/434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:29 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:29.966834 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:29.967427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:29.974540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.975038 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.975676 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:29.976585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:29.978073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:29.978073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:30.115337 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:30.123490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:30.125217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:30.126583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5e2403c3-67a2-4586-8d3c-504b099a79fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.164091 Oct 04 08:49:30.127152 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 205/435] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:29 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:30.915205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:30.915826 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] [instance: 0d0a9571-1186-4f66-bcb7-70c461bf339a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:30.922767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:30.923235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:30.923665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:30.924422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:30.924831 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:30.925255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:30.940835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] HTTP exception thrown: Instance 0d0a9571-1186-4f66-bcb7-70c461bf339a could not be found. Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Request method failure captured: Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a HTTP/1.1 Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_NADGyKIt9kF3IQh1cC-WLtxbWK5kRD4Kv-ZilzWrnqAm33n_sxiFaO4j79azrToDlf5_SuThFZg5la_QjTDRgKmekMM_dwyt6MLwQW1vuaNwjQvcoXqhvhlQ5XHe7rpu4KL2iE8nAvCZcfu0lWrzH3j_D4jFuauGILPJcJBJGYdvM Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 47f943270eaa45a4b5aec895741d553d Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesActionsTest-1682473865 Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:49:30.942721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f943270eaa45a4b5aec895741d553d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f943270eaa45a4b5aec895741d553d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f943270eaa45a4b5aec895741d553d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f943270eaa45a4b5aec895741d553d"}]}] Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesActionsTest-1682473865 Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 47f943270eaa45a4b5aec895741d553d Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesActionsTest-1682473865 Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesActionsTest-1682473865-project Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: efea00dacdca4d1d8e919fb446e164ea Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesActionsTest-1682473865-project Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 0d0a9571-1186-4f66-bcb7-70c461bf339a could not be found. Oct 04 08:49:30.944512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '0d0a9571-1186-4f66-bcb7-70c461bf339a'} Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0a9571-1186-4f66-bcb7-70c461bf339a could not be found. Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:49:30.945543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0a9571-1186-4f66-bcb7-70c461bf339a could not be found. Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0a9571-1186-4f66-bcb7-70c461bf339a could not be found. Oct 04 08:49:30.947278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:49:30.948554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] Returning 404 to user: Instance 0d0a9571-1186-4f66-bcb7-70c461bf339a could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:49:30.948554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-af4c49db-6ad3-44ed-a989-1ec59078ab22 tempest-VolumesActionsTest-1682473865 tempest-VolumesActionsTest-1682473865-project] 10.222.0.26 "GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a" status: 404 len: 111 microversion: 2.1 time: 0.033021 Oct 04 08:49:30.948554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 231/436] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:30 2022] GET /compute/v2.1/servers/0d0a9571-1186-4f66-bcb7-70c461bf339a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:49:31.116038 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-dc438b24-ad79-439f-bbe9-fbe2bff4f49d req-6a75a73d-b11e-4849-8645-c2bfe5cdfa9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:31.126021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-dc438b24-ad79-439f-bbe9-fbe2bff4f49d req-6a75a73d-b11e-4849-8645-c2bfe5cdfa9c service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:31.126500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-dc438b24-ad79-439f-bbe9-fbe2bff4f49d req-6a75a73d-b11e-4849-8645-c2bfe5cdfa9c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:31.126928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-dc438b24-ad79-439f-bbe9-fbe2bff4f49d req-6a75a73d-b11e-4849-8645-c2bfe5cdfa9c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:31.148423 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-dc438b24-ad79-439f-bbe9-fbe2bff4f49d req-6a75a73d-b11e-4849-8645-c2bfe5cdfa9c service nova] Creating event network-changed:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:49:31.153480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-dc438b24-ad79-439f-bbe9-fbe2bff4f49d req-6a75a73d-b11e-4849-8645-c2bfe5cdfa9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040918 Oct 04 08:49:31.154794 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 206/437] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:31.165278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:31.166256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:31.173170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:31.173917 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:31.174361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:31.175060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:31.175639 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:31.176062 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:31.394516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:31.402709 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:31.404533 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:31.406151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ae910b60-1064-4d48-aca1-d5d5286c0941 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.257600 Oct 04 08:49:31.407101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 232/438] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:31 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:32.433477 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:32.434295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:32.446707 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:32.447322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:32.447829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:32.448637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:32.449166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:32.449660 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:32.593976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:32.602585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:32.604035 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:32.605226 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ee63fde7-cceb-4528-8657-b72f9abd80a9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.176466 Oct 04 08:49:32.605801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 207/439] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:32 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:33.631818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:33.632422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:33.638769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:33.639249 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:33.639714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:33.640431 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:33.640878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:33.641510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:33.770349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:33.778448 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:33.779899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:33.781636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5e16289d-d9c8-4093-a667-32fb4c308fa1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.153760 Oct 04 08:49:33.782219 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 233/440] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:33 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:34.807867 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:34.808480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:34.816173 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:34.816664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:34.817096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:34.817819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:34.818276 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:34.818700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:34.963750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:34.972024 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:34.973464 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:34.974645 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-04c13c99-5a89-4041-8d13-58679599bc3b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.170835 Oct 04 08:49:34.975189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 208/441] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:34 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:35.999906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:36.000516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:36.006908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:36.007383 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:36.007808 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:36.008482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:36.008926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:36.009343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:36.139903 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:36.148330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:36.149830 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:36.151004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-56a28653-9b05-465c-99c2-0090df269802 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.154975 Oct 04 08:49:36.151548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 234/442] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:35 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:37.176357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:37.176991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:37.183475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:37.183951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:37.184381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:37.185058 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:37.185500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:37.185952 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:37.312038 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:37.319962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:37.321389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:37.322549 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f9a21aec-f1d6-47d8-a62b-29dd4bf6eb4c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.150052 Oct 04 08:49:37.323104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 209/443] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:37 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:38.350186 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:38.350836 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:38.357251 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:38.357765 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:38.358719 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:38.359402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:38.359850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:38.360270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:38.489389 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:38.497539 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:38.499046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:38.500223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5800c6b6-75d7-430a-9eca-93e213c71c00 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.153981 Oct 04 08:49:38.500803 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 235/444] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:38 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:39.525388 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:39.526017 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:39.532888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:39.533369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:39.533825 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:39.534508 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:39.534952 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:39.535370 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:39.666350 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:39.675078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:39.676553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:39.677754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-13e63dfd-8354-495f-8285-a05b673db20e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.156215 Oct 04 08:49:39.678313 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 210/445] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:39 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:40.394031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d02b12f8-4c68-438b-bc76-be4e9edd2eca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: .version_select at 0x7f5fd42fad30>, body: {"keypair": {"name": "tempest-keypair-1475675612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlgk7+fum9wPJxePg58f6urRBUj24RH4DXQcKMLaBd0u/Q5yptt3mk/IiuqOffWt9CP3Z9/Y5lAYfvNoh4AZ51HOZ1R8UzjMysEjwaXiGBhm648EkY5AlgXoVarpEjbcA=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:40.409531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-d02b12f8-4c68-438b-bc76-be4e9edd2eca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:49:40.413356 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-d02b12f8-4c68-438b-bc76-be4e9edd2eca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:49:40.434522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d02b12f8-4c68-438b-bc76-be4e9edd2eca tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044285 Oct 04 08:49:40.435097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 236/446] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:49:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:49:40.705748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:40.706562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:40.713840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:40.714419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:40.715026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:40.716461 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:40.716992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:40.719711 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:40.925119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:40.937123 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:40.938719 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:40.940009 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-395c9dc1-cdd3-44ee-aa98-9bb1dac75dab tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.239497 Oct 04 08:49:40.940616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 211/447] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:40 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:41.923554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1222786737", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbaa5ae-9515-4efe-ae61-91971a7f125f"}], "security_groups": [{"name": "tempest-securitygroup--807607566"}], "key_name": "tempest-keypair-1475675612", "user_data": "}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:41.968673 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:41.970631 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:41.978431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:41.979329 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:41.980157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:41.981095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:41.981954 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:41.982599 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:42.060706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] validate_networks() for [('fbbaa5ae-9515-4efe-ae61-91971a7f125f', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:49:42.157463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:42.172908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:42.174389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:42.175563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-372fd6be-2c6a-4849-9644-2591457e2fca tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.212782 Oct 04 08:49:42.181779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 212/448] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:41 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:42.555436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:49:42.556353 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:49:42.556841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:49:42.557476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:49:42.558261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:49:42.568398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:42.569098 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:42.569683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:42.570687 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:42.571317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:42.571735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:42.591247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:49:42.596054 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:49:42.608967 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:49:42.613052 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:49:42.673347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-60eb800b-ba65-4118-a108-513eaee74383 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.755307 Oct 04 08:49:42.674206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 237/449] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:49:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:49:42.685839 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9e5b3b70-05b1-4235-ab6e-521bf94528de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:42.687490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9e5b3b70-05b1-4235-ab6e-521bf94528de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:42.788980 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9e5b3b70-05b1-4235-ab6e-521bf94528de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:42.796506 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9e5b3b70-05b1-4235-ab6e-521bf94528de tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1242 microversion: 2.1 time: 0.115078 Oct 04 08:49:42.799420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 213/450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:42 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:43.202525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:43.204882 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:43.222530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:43.223436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:43.224064 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:43.225280 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:43.226209 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:43.227371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:43.419773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:43.429183 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:43.430778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:43.432582 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3bcf6a2c-173d-4f1b-8e40-7adb9b39a4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.235189 Oct 04 08:49:43.433618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 238/451] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:43 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:43.825286 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:43.827305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:43.841640 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:43.847073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:43.848247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:43.848932 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:43.849917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:43.851235 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:43.851905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:43.929988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:43.938095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-72a1de52-5bfd-45ef-97ae-71728182e10f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1294 microversion: 2.1 time: 0.121348 Oct 04 08:49:43.941517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 214/452] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:43 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:49:44.460348 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:44.462669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:44.488530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:44.489255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:44.489941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:44.490888 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:44.491513 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:44.492104 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:44.730152 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:44.740583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:44.742418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:44.743828 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-980fb261-d2b8-48d0-b391-bf8b56419393 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.287528 Oct 04 08:49:44.744554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 239/453] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:44 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:44.962520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:44.964173 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:44.972186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:44.972883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:44.973369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:44.974223 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:44.974868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:44.975473 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:45.054367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:45.064385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-410176f4-02bd-4f58-83de-f716d0e2d33c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1300 microversion: 2.1 time: 0.105946 Oct 04 08:49:45.065626 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 215/454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:44 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:45.776136 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:45.776744 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:45.784484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:45.785269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:45.785921 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:45.786830 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:45.787472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:45.788072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:46.018775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:46.037059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:46.039590 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:46.041205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-86ca18c0-2dcd-4d64-be27-c65d795e57e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.268709 Oct 04 08:49:46.042451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 240/455] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:45 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:46.091691 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:46.092804 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:46.099556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:46.100043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:46.100476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:46.101168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:46.101613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:46.102072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:46.255240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:46.265221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-794fcd14-f4c5-4293-92cc-fdd344cff818 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.177740 Oct 04 08:49:46.266278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 216/456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:46 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:46.400196 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-e2768b79-dae1-4699-b904-7263237b57c2 req-5743dc8a-b0f9-412d-9e3e-24244ebdc294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39d3753-4068-45e1-bf8c-1e7b4002137e", "tag": "2dffcb18-03be-456f-8c81-d846f5771bf0"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:46.413035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-e2768b79-dae1-4699-b904-7263237b57c2 req-5743dc8a-b0f9-412d-9e3e-24244ebdc294 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:46.413645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-e2768b79-dae1-4699-b904-7263237b57c2 req-5743dc8a-b0f9-412d-9e3e-24244ebdc294 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:46.414195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-e2768b79-dae1-4699-b904-7263237b57c2 req-5743dc8a-b0f9-412d-9e3e-24244ebdc294 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:46.428100 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-e2768b79-dae1-4699-b904-7263237b57c2 req-5743dc8a-b0f9-412d-9e3e-24244ebdc294 service nova] Creating event network-changed:2dffcb18-03be-456f-8c81-d846f5771bf0 for instance b39d3753-4068-45e1-bf8c-1e7b4002137e on hv-cinder-86021 Oct 04 08:49:46.435066 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-e2768b79-dae1-4699-b904-7263237b57c2 req-5743dc8a-b0f9-412d-9e3e-24244ebdc294 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038992 Oct 04 08:49:46.435927 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 241/457] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:47.068051 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:47.068662 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:47.077095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:47.077627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:47.078079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:47.078793 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:47.079241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:47.079660 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:47.228880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:47.241297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:47.243649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:47.244419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7014e699-062b-44e6-b42e-a299fa90927f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.180871 Oct 04 08:49:47.244943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 217/458] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:47 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:47.289518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:47.290240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:47.292213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:47.299816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:47.300045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:47.300587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:47.301357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:47.301945 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:47.302465 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:47.447867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:47.457995 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b57b0c82-b2e7-40b7-9b9a-7ee600b70aea tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.173003 Oct 04 08:49:47.458933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 242/459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:47 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:48.271949 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:48.272680 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:48.282065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:48.282549 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:48.283114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:48.283823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:48.284275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:48.284697 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:48.424315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:48.432625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:48.434219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:48.436118 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ecaff76d-8f55-49fe-af68-8e2ec3a8a645 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.167552 Oct 04 08:49:48.436666 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 218/460] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:48 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:48.481661 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:48.482552 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:48.489211 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:48.489941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:48.490366 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:48.491060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:48.491510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:48.491930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:48.507594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:48.627065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:48.635452 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7fe91dee-b149-4658-b01a-c1908c504c2d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.157577 Oct 04 08:49:48.636153 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 243/461] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:48 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:49.462606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:49.463919 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:49.471640 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:49.472041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:49.472475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:49.473287 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:49.473759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:49.474174 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:49.621402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:49.629881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:49.631755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:49.633090 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-36d60361-4f17-47e5-80d7-2520dfd02f36 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.174546 Oct 04 08:49:49.646167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 219/462] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:49 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:49.658436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:49.659828 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:49.671177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:49.671899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:49.672505 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:49.673198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:49.674041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:49.674434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:49.847721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:49.856084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a0e6fed3-c7e6-4409-86bb-8abb196480b3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.201895 Oct 04 08:49:49.856831 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 244/463] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:49 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:50.661305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:50.661962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:50.671399 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:50.672185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:50.672873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:50.675071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:50.675602 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:50.676268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:50.816522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:50.825489 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:50.827094 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:50.828458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ecaca7a1-e3cb-4c3e-88a0-6bd6902284b6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.171123 Oct 04 08:49:50.842241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 220/464] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:50 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:50.880058 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:50.880670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:50.887245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:50.887736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:50.888169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:50.888912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:50.889368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:50.889821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:51.039471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:51.047635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-db35b054-401c-4c57-abcb-2b79d491acac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.171364 Oct 04 08:49:51.048196 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 245/465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:50 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:51.855438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:51.856036 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:51.868755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:51.869247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:51.869682 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:51.870520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:51.871247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:51.871828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:51.895776 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:52.075077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:52.077449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:52.084519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:52.097943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:52.102990 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:52.104974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c8978147-129a-4da2-9d54-6225cfafaf8c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.253402 Oct 04 08:49:52.106093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 221/466] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:51 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:52.118950 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:52.119700 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:52.120641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:52.121526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:52.123832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:52.124445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:52.169308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-65110236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-322513154", "security_groups": [{"name": "tempest-secgroup-smoke-1244527694"}], "block_device_mapping_v2": [{"uuid": "4cc4a930-a596-4f7d-af8b-55a76d786c0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c006435c-ff61-43c2-8f47-dde46c8ddc02"}]}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:52.347228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] validate_networks() for [('c006435c-ff61-43c2-8f47-dde46c8ddc02', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:49:52.366563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:52.381582 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-38ee01d6-8e56-4860-a472-1fca021438bd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.314631 Oct 04 08:49:52.382437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 246/467] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:52 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:49:52.768588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:49:52.769474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:49:52.770326 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:49:52.770820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:49:52.771223 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:49:52.782024 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:52.782764 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:52.783398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:52.784458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:52.784920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:52.785352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:52.804965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:49:52.809225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for user f928852d90b94ac5979e4a7806896b7a and project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:49:52.880787 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:49:52.883002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cc4a930-a596-4f7d-af8b-55a76d786c0c',volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:49:53.050679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-49275b99-b9d4-4ab8-a003-6c1c161fe340 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885273 Oct 04 08:49:53.051425 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 222/468] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:49:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:49:53.064437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5b32da67-9545-471d-ae33-d22718f0b7a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:53.066983 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5b32da67-9545-471d-ae33-d22718f0b7a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:53.075336 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:53.078672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=10 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:53.133624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:53.134395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:53.145140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5b32da67-9545-471d-ae33-d22718f0b7a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:53.145326 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:53.146939 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:53.147378 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:53.148078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:53.148529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:53.148948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:53.153024 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5b32da67-9545-471d-ae33-d22718f0b7a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1092 microversion: 2.1 time: 0.093531 Oct 04 08:49:53.153595 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 247/469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:53 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1092 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:53.332263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:53.358120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:53.361508 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:53.363212 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9d518858-7e9c-4db7-a4c7-bc0672d92cf4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.233209 Oct 04 08:49:53.364031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 223/470] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:53 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:49:53.410889 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:53.412684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:53.424973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:53.425607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:53.426659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:53.427514 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:53.428868 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:53.429543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:53.657610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:53.666860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0438b207-6f08-4e12-ac6c-a66938144ddd tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.259948 Oct 04 08:49:53.673151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 248/471] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:53 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:54.177086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:54.177923 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:54.185031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:54.186327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:54.187058 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:54.188014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:54.188540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:54.189069 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:54.254328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:54.262751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-eb231b44-56bd-4729-b049-5d6384d171bd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1134 microversion: 2.1 time: 0.089782 Oct 04 08:49:54.278175 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 224/472] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:54 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1134 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:54.388613 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:54.389382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:54.396202 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:54.396767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:54.397198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:54.397908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:54.398514 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:54.399195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:54.536427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:54.547055 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:54.549170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:54.550515 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-de36fd76-2cb2-4a61-a875-99597a1ea824 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1743 microversion: 2.20 time: 0.165947 Oct 04 08:49:54.551349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 249/473] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:54 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:49:54.698292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:54.698897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:54.710137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:54.713541 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:54.714192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:54.715085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:54.716310 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:54.717010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:54.816998 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-70cafbd8-08a3-4e4a-a45a-3a239dcf5b75 req-257ea63c-bfc3-4986-81ac-6e55cecfd7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39d3753-4068-45e1-bf8c-1e7b4002137e", "name": "network-vif-plugged", "status": "completed", "tag": "2dffcb18-03be-456f-8c81-d846f5771bf0"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:54.852674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-70cafbd8-08a3-4e4a-a45a-3a239dcf5b75 req-257ea63c-bfc3-4986-81ac-6e55cecfd7f7 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:54.853339 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-70cafbd8-08a3-4e4a-a45a-3a239dcf5b75 req-257ea63c-bfc3-4986-81ac-6e55cecfd7f7 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:54.854841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-70cafbd8-08a3-4e4a-a45a-3a239dcf5b75 req-257ea63c-bfc3-4986-81ac-6e55cecfd7f7 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:54.868165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-70cafbd8-08a3-4e4a-a45a-3a239dcf5b75 req-257ea63c-bfc3-4986-81ac-6e55cecfd7f7 service nova] Creating event network-vif-plugged:2dffcb18-03be-456f-8c81-d846f5771bf0 for instance b39d3753-4068-45e1-bf8c-1e7b4002137e on hv-cinder-86021 Oct 04 08:49:54.887489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-70cafbd8-08a3-4e4a-a45a-3a239dcf5b75 req-257ea63c-bfc3-4986-81ac-6e55cecfd7f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074531 Oct 04 08:49:54.891756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 250/474] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:54.927614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:54.940858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-158fb3ac-c424-4f25-ab47-8e4272723e00 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.246598 Oct 04 08:49:54.953834 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 225/475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:54 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:55.291406 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:55.292602 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:55.302237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.302974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.303655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:55.304635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.305305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.305968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:55.378650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:55.387335 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-140ac08a-e412-4b7d-acf9-8b5eec088170 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1190 microversion: 2.1 time: 0.100493 Oct 04 08:49:55.388059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 251/476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:55 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1190 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:55.579226 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:55.580583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:55.587148 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.587707 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.588213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:55.589038 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.589710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.590335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:55.746273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:55.756128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:55.758085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:55.760284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b16a7881-7410-4ea7-b673-0d1ea2bbf956 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1743 microversion: 2.20 time: 0.185290 Oct 04 08:49:55.762034 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 226/477] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:55 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:55.967378 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:55.968428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:55.977881 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.978365 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.978807 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:55.979577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.980157 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.980671 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:56.132771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:56.141837 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c02884ac-4966-464d-978c-12e7a14ad629 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.180754 Oct 04 08:49:56.158959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 252/478] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:55 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:56.420876 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:56.420876 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:56.428888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:56.429659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:56.430364 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:56.431533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:56.432260 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:56.432902 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:56.504335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:56.513627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7a7a6b50-c02d-4c19-b7bd-0d02f69f670f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1198 microversion: 2.1 time: 0.100401 Oct 04 08:49:56.530379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 227/479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:56 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:56.786778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:56.787393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:56.793315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:56.794026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:56.795170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:56.796018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:56.796645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:56.797230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:56.939509 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:56.952360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:56.954755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:56.956312 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c1533e60-463d-4c7f-9564-1423e9aba015 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1743 microversion: 2.20 time: 0.173605 Oct 04 08:49:56.956868 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 253/480] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:56 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:57.165976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:57.168890 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:57.176032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:57.176763 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:57.177346 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:57.178227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:57.178826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:57.179402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:57.340891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:57.351358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3f80a42a-be42-4a4a-9a3d-1d27275e0baf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.190452 Oct 04 08:49:57.352116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 228/481] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:57 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:57.540267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:57.540966 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:57.547491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:57.547975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:57.548405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:57.549091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:57.549539 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:57.550014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:57.640388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:57.648582 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d933a4f8-8800-48b4-92a2-3251e860f13f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1208 microversion: 2.1 time: 0.111959 Oct 04 08:49:57.655970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 254/482] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:57 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:57.984026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:57.984635 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:57.990419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:57.990893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:57.991320 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:57.991995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:57.992447 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:57.992857 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:58.127145 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:58.137681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:58.139492 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:58.140782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b5c04462-76f2-40fe-b9dd-f7583b2eff07 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1743 microversion: 2.20 time: 0.161306 Oct 04 08:49:58.141441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 229/483] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:57 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:58.376399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:58.376947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:58.382722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:58.383225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:58.383652 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:58.384329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:58.384773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:58.385187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:58.522850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:58.531082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4c4ff207-1ffa-49a1-9165-0a103ba1cb9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1367 microversion: 2.1 time: 0.158572 Oct 04 08:49:58.531645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 255/484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:58 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:58.673221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:58.673937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:58.681765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:58.682255 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:58.682684 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:58.683406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:58.683852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:58.684273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:58.771791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-5c66cfe1-f999-4389-a0b6-aae49e35ab83 req-f9880a9c-9f52-465b-8cea-6ac0d5bd26f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c490e2-0104-4fcb-b255-1f1c8b41c083", "name": "network-vif-plugged", "status": "completed", "tag": "3cedc437-d079-40c2-a255-95cbfb8ae43c"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:58.785652 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5c66cfe1-f999-4389-a0b6-aae49e35ab83 req-f9880a9c-9f52-465b-8cea-6ac0d5bd26f8 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:58.786407 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5c66cfe1-f999-4389-a0b6-aae49e35ab83 req-f9880a9c-9f52-465b-8cea-6ac0d5bd26f8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:58.786821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5c66cfe1-f999-4389-a0b6-aae49e35ab83 req-f9880a9c-9f52-465b-8cea-6ac0d5bd26f8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:58.821819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-5c66cfe1-f999-4389-a0b6-aae49e35ab83 req-f9880a9c-9f52-465b-8cea-6ac0d5bd26f8 service nova] Creating event network-vif-plugged:3cedc437-d079-40c2-a255-95cbfb8ae43c for instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 on hv-cinder-86021 Oct 04 08:49:58.834522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-5c66cfe1-f999-4389-a0b6-aae49e35ab83 req-f9880a9c-9f52-465b-8cea-6ac0d5bd26f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062640 Oct 04 08:49:58.835692 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 256/485] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:58.948927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:58.958910 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7a2d947c-d21c-493b-9ffe-5fcd871ca609 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1276 microversion: 2.1 time: 0.291004 Oct 04 08:49:58.960028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 230/486] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:58 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:59.167489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:59.168303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:59.174603 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.175087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.175518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.176211 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.176663 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.177086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.415854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:59.424413 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:59.426075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:59.427453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7285a070-e78a-406b-8ed4-05a1a5a5b930 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1743 microversion: 2.20 time: 0.264159 Oct 04 08:49:59.428010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 257/487] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:49:59 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:49:59.554063 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:59.554675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:59.561193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.561681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.562166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.562883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.563333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.563784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.614396 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-262108aa-877a-4b37-a545-142ede95441a req-7fd508ca-19f0-4444-8b47-a1a6019875da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b291a8e2-ddea-408e-b850-2a968115efcf", "tag": "f3a2f548-e482-4524-83a5-a96b3b292574"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:49:59.635028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-262108aa-877a-4b37-a545-142ede95441a req-7fd508ca-19f0-4444-8b47-a1a6019875da service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.635556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-262108aa-877a-4b37-a545-142ede95441a req-7fd508ca-19f0-4444-8b47-a1a6019875da service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.635987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-262108aa-877a-4b37-a545-142ede95441a req-7fd508ca-19f0-4444-8b47-a1a6019875da service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.654754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-262108aa-877a-4b37-a545-142ede95441a req-7fd508ca-19f0-4444-8b47-a1a6019875da service nova] Creating event network-changed:f3a2f548-e482-4524-83a5-a96b3b292574 for instance b291a8e2-ddea-408e-b850-2a968115efcf on hv-cinder-86021 Oct 04 08:49:59.667529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-262108aa-877a-4b37-a545-142ede95441a req-7fd508ca-19f0-4444-8b47-a1a6019875da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056224 Oct 04 08:49:59.668553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 258/488] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:59.721604 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:49:59.729377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f21a1a52-cfa5-4348-8169-b4f6e362d546 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1557 microversion: 2.1 time: 0.179246 Oct 04 08:49:59.730061 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 231/489] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:59 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:59.752406 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:59.752985 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:59.759392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.759875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.760331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.761018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.761464 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.762248 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.983836 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:59.984397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:49:59.990758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.991253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.991690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:59.992397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:59.992853 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:59.993303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:00.087457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-97ffa7fe-1e83-43b3-8ee9-8e11cb136872 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.339750 Oct 04 08:50:00.088340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 259/490] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 08:49:59 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e/os-interface => generated 284 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:50:00.130534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:00.139726 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-25377c77-90e2-469a-9677-8fbf8a555e4c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.160242 Oct 04 08:50:00.140558 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 232/491] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:49:59 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:50:00.452684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:00.453403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:00.459711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:00.460458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:00.461069 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:00.461917 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:00.462455 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:00.463192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:00.898158 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:00.912707 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:00.919599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:00.921102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fa5bc575-29d2-481e-a8fa-bd95a02b7689 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.472439 Oct 04 08:50:00.921930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 260/492] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:00 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:01.174646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:01.177479 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:01.191185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:01.198395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:01.199441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:01.201649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:01.204138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:01.204870 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:01.436747 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:01.445498 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fd364570-33ed-418e-b8ee-73e2e1a19ab4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.284518 Oct 04 08:50:01.447314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 233/493] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:01 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:01.736007 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-0b115bc8-6a72-4605-8929-f972364bef49 req-fccfdeb9-d6fc-414e-ae09-c279bded8427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39d3753-4068-45e1-bf8c-1e7b4002137e", "tag": "2dffcb18-03be-456f-8c81-d846f5771bf0"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:50:01.748703 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0b115bc8-6a72-4605-8929-f972364bef49 req-fccfdeb9-d6fc-414e-ae09-c279bded8427 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:01.749525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0b115bc8-6a72-4605-8929-f972364bef49 req-fccfdeb9-d6fc-414e-ae09-c279bded8427 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:01.750249 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0b115bc8-6a72-4605-8929-f972364bef49 req-fccfdeb9-d6fc-414e-ae09-c279bded8427 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:01.767507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-0b115bc8-6a72-4605-8929-f972364bef49 req-fccfdeb9-d6fc-414e-ae09-c279bded8427 service nova] Creating event network-changed:2dffcb18-03be-456f-8c81-d846f5771bf0 for instance b39d3753-4068-45e1-bf8c-1e7b4002137e on hv-cinder-86021 Oct 04 08:50:01.788657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-0b115bc8-6a72-4605-8929-f972364bef49 req-fccfdeb9-d6fc-414e-ae09-c279bded8427 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053634 Oct 04 08:50:01.795521 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 261/494] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:50:01.948039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:01.948769 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:01.959278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:01.960679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:01.961391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:01.965904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:01.967224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:01.967879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:02.137123 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:02.149995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:02.153566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:02.155895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3173d448-3636-432b-bf71-c7c888463224 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.212545 Oct 04 08:50:02.157247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 234/495] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:01 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:02.472968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:02.473578 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:02.489281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:02.489794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:02.490223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:02.490918 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:02.491551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:02.491973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:02.914065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:02.923382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9df51a22-3c71-4697-9de8-66c324e22daf tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.455126 Oct 04 08:50:02.934029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 262/496] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:02 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:03.182528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:03.183314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:03.186988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:03.189233 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=8 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:03.210766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:03.212197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:03.212800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:03.226208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:03.226910 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:03.227793 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:03.510496 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:03.529815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:03.531904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:03.533889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fc172497-4e8e-4f29-8d5f-82a6301b96fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.355631 Oct 04 08:50:03.535143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 235/497] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:03 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:03.960323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:03.960983 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:03.963209 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:03.970458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:03.970961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:03.971393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:03.972086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:03.972536 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:03.972953 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:04.124264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:04.132834 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1bceb316-5e30-460c-b781-6f92ce916667 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.178336 Oct 04 08:50:04.133398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 263/498] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:03 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:04.565048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:04.565735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:04.572205 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:04.573025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:04.573453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:04.574336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:04.574975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:04.575618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:04.748088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:04.757646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:04.758948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:04.760197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bc0f5664-1eb6-4617-a3d1-bad2a024bcf1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.199075 Oct 04 08:50:04.760756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 236/499] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:04 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:05.161047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:05.163128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:05.171379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:05.171975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:05.172636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:05.173473 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:05.174036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:05.174724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:05.179548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:05.316611 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:05.327453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c8d2a3df-503a-4f0c-b96c-138ead854bdb tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.172214 Oct 04 08:50:05.329880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 264/500] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:05 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:50:05.785627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:05.786340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:05.792817 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:05.793506 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:05.794769 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:05.795782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:05.796517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:05.797101 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:05.944739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:05.953681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:05.955599 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:05.956839 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7e77dacd-bf7d-4c4c-86bf-900b99a5b87c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.175061 Oct 04 08:50:05.957392 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 237/501] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:05 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:06.353163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:06.354624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:06.362116 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:06.362802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:06.363332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:06.364184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:06.364733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:06.365583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:06.515473 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:06.526464 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a7711dff-19e7-49ac-a42f-93cc307adec8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.177433 Oct 04 08:50:06.527498 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 265/502] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:06 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:06.983639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:06.984183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:06.990537 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:06.991538 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:06.992046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:06.992806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:06.993328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:06.993778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:07.010297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:07.169358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:07.180436 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:07.183463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:07.186834 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c5599a0a-ad3e-44b7-b726-1242917e2eba tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.206539 Oct 04 08:50:07.187625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 238/503] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:06 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:07.550730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:07.551337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:07.558841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:07.559339 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:07.560439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:07.561233 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:07.561922 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:07.562566 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:07.727241 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:07.740182 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-04b1d135-fdb2-4da9-be98-dcb8798fc124 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.193658 Oct 04 08:50:07.740824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 266/504] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:07 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:08.218942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:08.219525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:08.226606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:08.227314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:08.227913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:08.229116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:08.229574 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:08.230020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:08.377055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:08.385567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:08.387272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:08.389302 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8b13dd47-a428-42c6-8e49-a67e7776bf79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.175220 Oct 04 08:50:08.390193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 239/505] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:08 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:08.764664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:08.769620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:08.777127 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:08.778357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:08.779674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:08.780664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:08.782045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:08.782706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:08.945918 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:08.955101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ab433589-e171-46a2-b249-eafce6fd3613 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.196273 Oct 04 08:50:08.956204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 267/506] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:08 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:09.418483 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:09.420262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:09.426779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:09.427254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:09.427736 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:09.428363 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:09.428810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:09.429227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:09.593979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:09.603943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:09.605429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:09.606685 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6f4cb4b6-bfcd-4c72-bac7-7e1a49c85461 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.192246 Oct 04 08:50:09.607766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 240/507] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:09 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:09.979484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:09.980768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:09.986871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:09.987364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:09.987807 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:09.988526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:09.988985 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:09.989424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:10.148726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:10.160081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9e5f463c-2ac1-409d-8031-be7e0bae3296 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.185096 Oct 04 08:50:10.160830 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 268/508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:09 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:50:10.636810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:10.638216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:10.644856 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:10.645345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:10.645803 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:10.646496 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:10.646944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:10.647551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:10.801775 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:10.812675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:10.814176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:10.815438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0f5b9199-6f7f-40c0-9da9-645e559c6ca0 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.182767 Oct 04 08:50:10.816003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 241/509] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:10 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:11.183278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:11.184003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:11.191111 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:11.191572 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:11.192011 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:11.192700 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:11.193145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:11.193562 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:11.333670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:11.347591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-949a713a-e68d-4206-9d1a-88abc258e43d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.167563 Oct 04 08:50:11.348339 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 269/510] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:11 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:11.438547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-fc15e394-1cb0-4605-b8bc-6e140206fd60 req-b8f7b962-3725-444d-82b6-183cb9308c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b291a8e2-ddea-408e-b850-2a968115efcf", "name": "network-vif-plugged", "status": "completed", "tag": "f3a2f548-e482-4524-83a5-a96b3b292574"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:50:11.448085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-fc15e394-1cb0-4605-b8bc-6e140206fd60 req-b8f7b962-3725-444d-82b6-183cb9308c14 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:11.448577 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-fc15e394-1cb0-4605-b8bc-6e140206fd60 req-b8f7b962-3725-444d-82b6-183cb9308c14 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:11.449012 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-fc15e394-1cb0-4605-b8bc-6e140206fd60 req-b8f7b962-3725-444d-82b6-183cb9308c14 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:11.460872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-fc15e394-1cb0-4605-b8bc-6e140206fd60 req-b8f7b962-3725-444d-82b6-183cb9308c14 service nova] Creating event network-vif-plugged:f3a2f548-e482-4524-83a5-a96b3b292574 for instance b291a8e2-ddea-408e-b850-2a968115efcf on hv-cinder-86021 Oct 04 08:50:11.467827 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-fc15e394-1cb0-4605-b8bc-6e140206fd60 req-b8f7b962-3725-444d-82b6-183cb9308c14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032831 Oct 04 08:50:11.468451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 242/511] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:50:11.840978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:11.841504 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:11.847457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:11.847926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:11.848351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:11.849054 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:11.849502 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:11.849952 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:11.984599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:11.992864 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:11.994331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:11.995476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-795d12de-31f3-4142-a5cc-2980bdf72ea8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1738 microversion: 2.20 time: 0.158778 Oct 04 08:50:11.996022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 270/512] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:11 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:12.377392 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:12.378654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:12.384980 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:12.385469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:12.385940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:12.386646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:12.387100 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:12.387780 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:12.526871 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:12.535108 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-44157aa1-837f-4937-8880-ce3bf20d6e49 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.166521 Oct 04 08:50:12.535673 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 243/513] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:12 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:13.021328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:13.021961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:13.028161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:13.028641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:13.029077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:13.029788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:13.030244 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:13.030670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:13.161023 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:13.168935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:13.170416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:13.171827 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4c742821-3b04-4992-935a-9b0d3fbb9c3c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1720 microversion: 2.20 time: 0.154515 Oct 04 08:50:13.172387 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 271/514] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:13 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:13.558484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:13.559030 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:13.566119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:13.566610 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:13.567042 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:13.567726 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:13.568176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:13.568600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:13.703718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:13.711621 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0d4bc2a2-b06c-492d-933b-78999b61f4c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.157113 Oct 04 08:50:13.712178 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 244/515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:13 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:14.197115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:14.197758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:14.205225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:14.205733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:14.206184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:14.206874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:14.207331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:14.207759 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:14.345714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:14.354312 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:14.355768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:14.356931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-dca12cce-62e5-4c23-b67d-5eda12bef8f7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1720 microversion: 2.20 time: 0.163751 Oct 04 08:50:14.357516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 272/516] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:14 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:14.735723 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:14.736259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:14.738607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:14.744068 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:14.744557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:14.744992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:14.745739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:14.746213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:14.746639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:14.879493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:14.887269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c1001dcd-b351-4cf7-adfd-a83053868629 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.155461 Oct 04 08:50:14.887850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 245/517] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:14 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:15.382067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:15.383042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:15.385337 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-00fd1d00-77d7-45dd-8944-ec7d5e0b93ed req-4e2cc599-8c8f-4c63-9470-e088244e3200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c490e2-0104-4fcb-b255-1f1c8b41c083", "name": "network-vif-unplugged", "status": "completed", "tag": "3cedc437-d079-40c2-a255-95cbfb8ae43c"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:50:15.389308 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:15.389971 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:15.390495 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:15.391096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:15.391617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:15.392131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:15.395566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-00fd1d00-77d7-45dd-8944-ec7d5e0b93ed req-4e2cc599-8c8f-4c63-9470-e088244e3200 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:15.396113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-00fd1d00-77d7-45dd-8944-ec7d5e0b93ed req-4e2cc599-8c8f-4c63-9470-e088244e3200 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:15.396580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-00fd1d00-77d7-45dd-8944-ec7d5e0b93ed req-4e2cc599-8c8f-4c63-9470-e088244e3200 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:15.410838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-00fd1d00-77d7-45dd-8944-ec7d5e0b93ed req-4e2cc599-8c8f-4c63-9470-e088244e3200 service nova] Creating event network-vif-unplugged:3cedc437-d079-40c2-a255-95cbfb8ae43c for instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 on hv-cinder-86021 Oct 04 08:50:15.416637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-00fd1d00-77d7-45dd-8944-ec7d5e0b93ed req-4e2cc599-8c8f-4c63-9470-e088244e3200 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034794 Oct 04 08:50:15.417562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 246/518] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:50:15.526863 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:15.535317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:15.536786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:15.538059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-00d1d1d2-4f91-4c70-b9a0-05aaca9fd556 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1720 microversion: 2.20 time: 0.160135 Oct 04 08:50:15.538610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 273/519] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:15 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:15.911733 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:15.912345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:15.918399 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:15.918870 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:15.919330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:15.920010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:15.920453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:15.920869 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:16.051454 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:16.059330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-08a01771-7358-41f9-96a5-00842566ec2d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1264 microversion: 2.1 time: 0.152386 Oct 04 08:50:16.059889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 247/520] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:15 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:16.564507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:16.565191 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:16.571714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:16.572186 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:16.572624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:16.573305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:16.573781 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:16.574201 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:16.712291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:16.721569 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:16.722967 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:16.724153 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2563a8dd-1a85-485a-aa5a-a83c8876cf5b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1720 microversion: 2.20 time: 0.164175 Oct 04 08:50:16.724701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 274/521] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:16 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:17.082720 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:17.083335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:17.095855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:17.096336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:17.096767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:17.097450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:17.097924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:17.098348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:17.231757 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:17.239993 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-16d03964-82ba-441c-9765-090ac29e4d8d tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1451 microversion: 2.1 time: 0.161215 Oct 04 08:50:17.240544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 248/522] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:17 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:17.266994 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:17.267606 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:17.273474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:17.273986 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:17.274422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:17.275111 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:17.275559 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:17.275984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:17.407714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:17.421847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1870b740-1701-4abf-b0e9-a4e5e633b5c3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1451 microversion: 2.1 time: 0.158642 Oct 04 08:50:17.422504 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 275/523] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:50:17 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:50:17.750641 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:17.751282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:17.757067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:17.757553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:17.758039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:17.758735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:17.759192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:17.759646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:17.987455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:17.996842 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:17.998445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:17.999693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-757b34e4-b298-4ba2-ba80-9333c73c7f5c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1723 microversion: 2.20 time: 0.253203 Oct 04 08:50:18.000507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 249/524] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:17 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:18.025096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f211ab0a-60eb-4f6b-b734-331fd4e8ebd3"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:50:18.027561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:18.030510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=70 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:18.036162 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:18.036747 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:18.037255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:18.038063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:18.038608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:18.039105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:18.326817 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-63a64761-d533-4adc-b58a-62f2f51d0837 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305672 Oct 04 08:50:18.327418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 276/525] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Oct 4 08:50:18 2022] POST /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:50:18.458829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:50:18.459410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:18.466003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:18.466517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:18.466949 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:18.467679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:18.468128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:18.468546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:18.515881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126939) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 08:50:18.584327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3987cff0-a704-4fa8-875e-f7a230014685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/action" status: 202 len: 0 microversion: 2.20 time: 0.129252 Oct 04 08:50:18.585260 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 250/526] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 08:50:18 2022] POST /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:50:18.593558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:18.594291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:18.602814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:18.603316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:18.603907 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:18.604462 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:18.604918 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:18.605346 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:18.747904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:18.757613 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:18.759721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:18.761404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7ee559ab-602e-4f3d-a116-06430b61f0e8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1749 microversion: 2.20 time: 0.172069 Oct 04 08:50:18.771279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 277/527] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:18 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:19.558006 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-a9570652-6b1f-455f-85ed-9758bbd29a43 req-9ed5197f-2b17-4986-a8a0-2d99e3d239ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b291a8e2-ddea-408e-b850-2a968115efcf", "tag": "f3a2f548-e482-4524-83a5-a96b3b292574"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:50:19.568568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-a9570652-6b1f-455f-85ed-9758bbd29a43 req-9ed5197f-2b17-4986-a8a0-2d99e3d239ce service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:19.569040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-a9570652-6b1f-455f-85ed-9758bbd29a43 req-9ed5197f-2b17-4986-a8a0-2d99e3d239ce service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:19.569468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-a9570652-6b1f-455f-85ed-9758bbd29a43 req-9ed5197f-2b17-4986-a8a0-2d99e3d239ce service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:19.582284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-a9570652-6b1f-455f-85ed-9758bbd29a43 req-9ed5197f-2b17-4986-a8a0-2d99e3d239ce service nova] Creating event network-changed:f3a2f548-e482-4524-83a5-a96b3b292574 for instance b291a8e2-ddea-408e-b850-2a968115efcf on hv-cinder-86021 Oct 04 08:50:19.587610 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-a9570652-6b1f-455f-85ed-9758bbd29a43 req-9ed5197f-2b17-4986-a8a0-2d99e3d239ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034473 Oct 04 08:50:19.588215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 251/528] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:50:19.796716 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:19.797628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:19.811238 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:19.811725 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:19.817099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:19.818232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:19.818709 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:19.819259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:19.823575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:20.062020 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:20.070757 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:20.072192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:20.073397 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-49916ab8-d1ce-43b3-a76a-19fa82035347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1751 microversion: 2.20 time: 0.289362 Oct 04 08:50:20.074008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 278/529] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:19 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1751 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:21.100486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:21.101185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:21.108109 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:21.108586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:21.109023 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:21.109759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:21.110349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:21.110948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:21.241823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:21.250383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:21.251815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:21.252959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ccc446e2-f4da-4665-9d73-7d9a8b3cfa3f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.157316 Oct 04 08:50:21.253504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 252/530] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:21 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:22.278851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:22.279456 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:22.286013 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:22.286499 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:22.286931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:22.287622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:22.288070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:22.288491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:22.421841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:22.430674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:22.432260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:22.433474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-26d42003-3f01-442b-bae1-c542f0ff8ac6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.158691 Oct 04 08:50:22.433985 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 279/531] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:22 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:23.459699 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:23.460300 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:23.466974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:23.467449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:23.467877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:23.468578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:23.469022 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:23.469436 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:23.602688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:23.611323 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:23.612753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:23.613936 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0f739a65-9b9e-4759-a211-256a04a32cc7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.158137 Oct 04 08:50:23.614490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 253/532] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:23 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:24.640461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:24.641200 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:24.647889 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:24.648376 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:24.648812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:24.649526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:24.650022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:24.650450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:24.786790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:24.796125 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:24.797567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:24.798876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-db83825b-3be1-4b8a-9761-6a8fdf688efd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.162256 Oct 04 08:50:24.799433 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 280/533] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:24 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:25.824751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:25.825382 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:25.832013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:25.832496 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:25.832928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:25.833620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:25.834317 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:25.834742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:25.962815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:25.972429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:25.973899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:25.975055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-06a339cd-a04f-41cb-8d66-36eb0bf55f2d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.154339 Oct 04 08:50:25.975862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 254/534] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:25 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:27.001842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:27.002390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:27.008921 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:27.009404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:27.009875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:27.010579 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:27.011029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:27.011457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:27.148787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:27.158261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:27.159703 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:27.161027 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c98c2dcd-789e-415f-98c4-7187925804d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.163795 Oct 04 08:50:27.161843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 281/535] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:26 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:28.187227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:28.187965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:28.194506 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:28.194996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:28.195398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:28.196075 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:28.196516 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:28.196931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:28.343623 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:28.353320 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:28.354781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:28.355924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-19772bea-5ca5-42be-ae3e-55149026f9c6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.173834 Oct 04 08:50:28.359899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 255/536] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:28 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:29.382628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:29.383364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:29.390550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:29.391029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:29.391459 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:29.392176 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:29.392631 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:29.393061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:29.601118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:29.612969 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:29.614714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:29.615884 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c2b8614e-35cf-4458-b224-0dbbeaf17f4d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.237689 Oct 04 08:50:29.616449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 282/537] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:29 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:30.641221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:30.641866 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:30.648493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:30.648987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:30.649419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:30.650159 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:30.650620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:30.651047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:30.653940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:30.792333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:30.801357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:30.802856 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:30.803995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b38f4dff-35f9-4b98-a0b1-d94911a8c852 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.166750 Oct 04 08:50:30.804543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 256/538] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:30 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:31.830455 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:31.831137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:31.837471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:31.837978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:31.838411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:31.839094 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:31.839540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:31.840209 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:31.976737 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:31.985451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:31.987030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:31.988204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9d3b9552-a8eb-43db-8f11-88017084deb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.161636 Oct 04 08:50:31.988765 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 283/539] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:31 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:33.013674 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:33.017237 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:33.024438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:33.024937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:33.025388 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:33.026101 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:33.027057 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:33.027758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:33.190282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:33.198978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:33.200482 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:33.201624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0450b2ce-46b3-44c8-9364-808ecff83312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.192071 Oct 04 08:50:33.202205 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 257/540] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:33 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:34.231148 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:34.232131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:34.239550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:34.240008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:34.240759 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:34.241650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:34.242306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:34.242725 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:34.405863 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:34.414454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:34.415887 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:34.417071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6a9532e1-a263-4911-9c60-0e171c02364b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.192968 Oct 04 08:50:34.417630 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 284/541] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:34 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:35.443828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:35.444934 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:35.455916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:35.456402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:35.456840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:35.457535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:35.458021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:35.458449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:35.584341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:35.593681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:35.595153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:35.596312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0a0b3dbf-38ae-447b-a71a-5eee7a080235 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.157159 Oct 04 08:50:35.596872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 258/542] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:35 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:36.622422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:36.623635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:36.630088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:36.630567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:36.631003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:36.631733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:36.632185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:36.632605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:36.773733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:36.782166 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:36.783610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:36.784760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-42b75f33-769e-47f3-ac7b-6c43dcdd4331 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.166322 Oct 04 08:50:36.785322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 285/543] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:36 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:37.809941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:37.811115 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:37.817446 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:37.817961 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:37.818403 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:37.819095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:37.819552 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:37.819979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:37.993877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:38.002867 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:38.004317 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:38.005476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8f932a72-097c-4cd7-b8aa-8211a0e7d89c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.199495 Oct 04 08:50:38.006075 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 259/544] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:37 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:39.031907 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:39.032526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:39.038865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:39.039342 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:39.039773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:39.040453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:39.040896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:39.041310 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:39.214150 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:39.222826 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:39.224256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:39.225398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-827fd95c-6e0c-4f61-a0f1-99b31bf3c81c tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.198013 Oct 04 08:50:39.225987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 286/545] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:39 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:40.250828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:40.251439 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:40.257709 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:40.258198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:40.258634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:40.259315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:40.259765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:40.260188 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:40.389995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:40.398531 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:40.399966 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:40.401107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a90cf9c1-1a8a-43df-9582-255f37e0bcd7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.154172 Oct 04 08:50:40.401668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 260/546] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:40 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:41.426407 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:41.427043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:41.433397 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:41.433915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:41.434348 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:41.435531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:41.435979 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:41.436396 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:41.564991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:41.573485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:41.575002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:41.576731 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-eaa1c93f-7891-4072-9575-9be6938f6f22 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.154310 Oct 04 08:50:41.577284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 287/547] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:41 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:42.602754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:42.603359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:42.609459 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:42.610027 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:42.610454 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:42.611125 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:42.611568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:42.611984 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:42.738087 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:42.746502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:42.747928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:42.749064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-482f6e5b-daac-4f90-8f21-f1b9c15235ac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.150202 Oct 04 08:50:42.749612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 261/548] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:42 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:43.774036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:43.774662 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:43.780775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:43.781321 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:43.781795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:43.782486 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:43.782966 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:43.783393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:43.911063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:43.919526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:43.920974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:43.922167 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-95b450ef-1291-40dd-a74c-1bd668497ae9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.152270 Oct 04 08:50:43.922721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 288/549] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:43 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:44.947716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:44.948339 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:44.950637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:44.956292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:44.956766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:44.957195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:44.957905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:44.958350 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:44.958769 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:45.091002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:45.100340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:45.101781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:45.102926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-aa767213-4610-40c6-9f37-9c16cfe10b90 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.159087 Oct 04 08:50:45.103479 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 262/550] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:44 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:46.128279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:46.128894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:46.136811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:46.136811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:46.136811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:46.138226 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:46.138602 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:46.139047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:46.282365 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:46.291048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:46.292487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:46.293847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-64511675-a3eb-4db2-a409-fd86baa7912a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.169435 Oct 04 08:50:46.294741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 289/551] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:46 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:47.320833 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:47.321439 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:47.327900 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:47.328705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:47.329369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:47.330319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:47.330829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:47.331481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:47.481084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:47.491442 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:47.492897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:47.494344 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5d9a6533-6708-499c-b3ee-f3b3fb5994f1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.177145 Oct 04 08:50:47.494954 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 263/552] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:47 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:48.520044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:48.520668 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:48.523465 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=28 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:48.530538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:48.531037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:48.531768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:48.532801 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:48.533273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:48.533721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:48.767496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:48.776873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:48.778352 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:48.780525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-46443fb8-0d27-4bca-b194-1a3ad59295cf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.264342 Oct 04 08:50:48.793712 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 290/553] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:48 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:49.807283 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:49.808068 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:49.814951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:49.815535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:49.816039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:49.816739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:49.817193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:49.817612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:50.045586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:50.054950 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:50.056675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:50.057977 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-68a9cfff-c725-4ddd-a16c-326df3f3b4e2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.255835 Oct 04 08:50:50.058617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 264/554] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:49 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:51.091162 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:51.091859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:51.101995 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:51.102568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:51.103073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:51.103911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:51.104572 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:51.105078 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:51.110266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=78 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:51.299060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:51.308801 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:51.310428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:51.311585 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a0adf52d-706e-4766-9e98-126c4862329f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.231396 Oct 04 08:50:51.312316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 291/555] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:51 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:52.726105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:52.727266 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:52.740463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:52.740963 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:52.741410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:52.742161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:52.742617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:52.743168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:53.010670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:53.021319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:53.023151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:53.024578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f62651b3-3965-4cd5-87bd-9063b57ec131 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.690490 Oct 04 08:50:53.038448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 265/556] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:52 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:54.052188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:54.052776 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:54.059873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:54.060398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:54.060834 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:54.061744 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:54.062200 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:54.062618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:54.305818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:54.319253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:54.320696 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:54.327720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f3efc088-72ba-4054-86c9-e8717dcae4a6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.279493 Oct 04 08:50:54.342177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 292/557] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:54 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:55.356977 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:55.358848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:55.368257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:55.368945 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:55.369475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:55.370289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:55.370815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:55.371316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:55.549635 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:55.562192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:55.563728 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:55.565194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f5e496f1-4e19-4dc3-bf9d-afcc63ab79ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.213784 Oct 04 08:50:55.566020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 266/558] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:55 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:56.027858 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-249301e3-e583-4f02-b954-853f03c77b0c tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Action: 'create', calling method: .version_select at 0x7f5fd42305e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1491432777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXAexYJv8nJxbp9EXv/15wsObrM+GwbH+eLzOKY1+M7UpKuQE9kF//mBkAsIxZL++l+Mm+Dx6IeUzlz/JlibtjyQCB0xpDBnDc/KxzOudUDChZQyAG5pBrAnIoiLM3cUA=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:50:56.044303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-249301e3-e583-4f02-b954-853f03c77b0c tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Getting quotas for project 4a75a59f42a74dee854ddc7b5f109143. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:50:56.048771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-249301e3-e583-4f02-b954-853f03c77b0c tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Getting quotas for user dfe240ebc7c643358db4ae3a9ef132ea and project 4a75a59f42a74dee854ddc7b5f109143. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:50:56.078026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-249301e3-e583-4f02-b954-853f03c77b0c tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.153650 Oct 04 08:50:56.079411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 293/559] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:50:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:50:56.594943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:56.596118 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:56.606658 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:56.607290 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:56.607833 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:56.608627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:56.609175 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:56.609734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:56.821367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:56.832449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:56.834213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:56.835631 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-01a1428f-18d5-4983-a78d-78c895ec253b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.248013 Oct 04 08:50:56.836755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 267/560] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:56 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:57.863147 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:57.863733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:57.870491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:57.871035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:57.871568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:57.872759 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:57.873197 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:57.873665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:58.006676 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:58.015966 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:58.017416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:58.018640 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5b313bc1-4e8f-44c8-8f98-b8afb8734ca1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.159986 Oct 04 08:50:58.019292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 294/561] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:57 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:59.044964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:59.046221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:50:59.052766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:59.053251 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:59.053700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:59.054396 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:59.054846 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:59.055269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:59.191798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:59.201326 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:59.202818 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:50:59.203998 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-48666050-5846-4464-832e-d74d6a5e5a82 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.163035 Oct 04 08:50:59.204556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 268/562] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:50:59 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:00.230360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:00.230974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:00.238690 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:00.239496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:00.240135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:00.241106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:00.241782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:00.242322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:00.390357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:00.401005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:00.414703 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:00.416398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-574fdc83-7eb4-4c0c-8527-e53682e1ef1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.189997 Oct 04 08:51:00.417823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 295/563] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:00 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:01.443174 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:01.443778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:01.450149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:01.450622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:01.451054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:01.451726 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:01.452168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:01.452583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:01.455089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=78 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:01.588054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:01.597272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:01.598749 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:01.599950 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-94c27d1b-bdb5-48b7-883d-172ecd5ff77a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.160663 Oct 04 08:51:01.600518 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 269/564] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:01 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:02.104709 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-09b85eea-0a9b-4c58-b71e-a916d1690474 req-809889a8-f165-4ca5-a5b3-e1bcd5f1ed5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c490e2-0104-4fcb-b255-1f1c8b41c083", "name": "network-vif-plugged", "status": "completed", "tag": "3cedc437-d079-40c2-a255-95cbfb8ae43c"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:02.114470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-09b85eea-0a9b-4c58-b71e-a916d1690474 req-809889a8-f165-4ca5-a5b3-e1bcd5f1ed5c service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:02.114953 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-09b85eea-0a9b-4c58-b71e-a916d1690474 req-809889a8-f165-4ca5-a5b3-e1bcd5f1ed5c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:02.115380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-09b85eea-0a9b-4c58-b71e-a916d1690474 req-809889a8-f165-4ca5-a5b3-e1bcd5f1ed5c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:02.126241 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-09b85eea-0a9b-4c58-b71e-a916d1690474 req-809889a8-f165-4ca5-a5b3-e1bcd5f1ed5c service nova] Creating event network-vif-plugged:3cedc437-d079-40c2-a255-95cbfb8ae43c for instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 on hv-cinder-86021 Oct 04 08:51:02.134723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-09b85eea-0a9b-4c58-b71e-a916d1690474 req-809889a8-f165-4ca5-a5b3-e1bcd5f1ed5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Oct 04 08:51:02.135290 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 296/565] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:02.626327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:02.626936 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:02.633410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:02.633938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:02.634375 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:02.635079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:02.635529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:02.635953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:02.770752 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:02.779268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:02.780693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:02.781874 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6d6ebb85-fd5a-4372-a94d-966fee2bd47d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.159915 Oct 04 08:51:02.782513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 270/566] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:02 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:03.809025 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:03.809753 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:03.816161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:03.816645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:03.817080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:03.817808 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:03.818266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:03.818689 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:03.959445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:03.968390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:03.969870 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:03.971049 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d75580a6-15de-4d36-90db-8717d1a4bde7 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.166899 Oct 04 08:51:03.971631 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 297/567] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:03 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:04.996497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:04.997116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:05.003754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:05.004252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:05.004685 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:05.005396 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:05.005883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:05.006304 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:05.137959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:05.146627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:05.148051 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:05.149194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d440c1c8-0c10-400a-bfea-7f96427741f6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.156711 Oct 04 08:51:05.149751 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 271/568] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:04 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:06.176740 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:06.177351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:06.180484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=4 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:06.186195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:06.186751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:06.187246 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:06.188005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:06.188558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:06.189051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:06.321809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:06.330714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:06.332255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:06.333438 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-201823d0-508e-47f5-97e1-f98475f36d39 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1807 microversion: 2.20 time: 0.161552 Oct 04 08:51:06.334037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 298/569] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:06 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:07.362544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:07.363134 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:07.369507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:07.370029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:07.370473 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:07.371164 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:07.371619 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:07.372046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:07.506595 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:07.516146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:07.517808 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:07.518810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-33ad10d0-c14a-4baa-bd22-ed71b0772b94 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1794 microversion: 2.20 time: 0.160181 Oct 04 08:51:07.519372 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 272/570] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:51:07 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:51:13.715287 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71da5d61-c693-4867-8f1c-8be30289906d"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:13.718318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:13.724215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:13.724699 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:13.725135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:13.725850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:13.726306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:13.726731 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:13.995442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d347e8d7-99e5-4dc8-9198-6296d30c822a tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381656 Oct 04 08:51:13.996105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 299/571] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:51:13 2022] POST /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:22.573178 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:22.575545 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:22.577540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=21 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:22.578299 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=23 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:22.584064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:22.584552 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:22.584991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:22.585684 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:22.586162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:22.586594 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:22.610046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lazy-loading 'flavor' on Instance uuid 0b2c9f68-135f-4233-ab6b-497b6be10b2d {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:51:22.732134 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-606cfada-f9b3-4c88-af4e-2de38799d73d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/action" status: 200 len: 32 microversion: 2.1 time: 0.162245 Oct 04 08:51:22.732816 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 273/572] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:51:22 2022] POST /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:51:22.743419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:22.744121 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:22.746160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:22.753137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:22.753640 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:22.754101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:22.754798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:22.755252 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:22.755716 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:22.759093 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:22.891741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:22.900015 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a84a0eae-de34-42ab-96d2-4cfc75881bf9 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.161562 Oct 04 08:51:22.900591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 300/573] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:22 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:23.924801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:23.925419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:23.931584 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:23.932093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:23.932536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:23.933217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:23.933666 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:23.934114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:24.063428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:24.071880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2fb2b3a5-c11b-4a93-984f-3e1c8fc2f6e1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.151783 Oct 04 08:51:24.072445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 274/574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:23 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:24.095636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-926876879", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1491432777", "security_groups": [{"name": "tempest-secgroup-smoke-705209460"}], "networks": [{"uuid": "538776f6-b9c7-4f26-8e61-2d15055e47f5"}], "block_device_mapping_v2": [{"uuid": "1a8b9203-d320-4673-b59c-53e351a46c28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:24.192878 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:24.195160 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:24.200914 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:24.201393 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:24.201859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:24.202548 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:24.203028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:24.203449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:24.207416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] validate_networks() for [('538776f6-b9c7-4f26-8e61-2d15055e47f5', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:51:24.287739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-dea0ae87-d2c1-4080-a480-5b03074c22f5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/action" status: 202 len: 0 microversion: 2.1 time: 0.098699 Oct 04 08:51:24.292622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 275/575] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:51:24 2022] POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:51:24.298944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:24.299641 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:24.306028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:24.306513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:24.306982 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:24.307653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:24.308100 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:24.308518 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:24.457058 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:24.466405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c4ee200b-fd0c-4a5d-9d01-6f98c7e35b4c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1752 microversion: 2.1 time: 0.171946 Oct 04 08:51:24.466964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 276/576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:24 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:24.791367 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:51:24.791788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:51:24.792254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:51:24.792656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:51:24.793059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:51:24.801797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:24.802277 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:24.802734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:24.803422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:24.803871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:24.804289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:24.821145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Getting quotas for project 4a75a59f42a74dee854ddc7b5f109143. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:51:24.825584 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Getting quotas for user dfe240ebc7c643358db4ae3a9ef132ea and project 4a75a59f42a74dee854ddc7b5f109143. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:51:24.882236 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:51:24.884388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a8b9203-d320-4673-b59c-53e351a46c28',volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:51:25.025720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-57b4ac3c-a59e-4822-af36-c79660269411 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.933832 Oct 04 08:51:25.026445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 301/577] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:51:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:51:25.037506 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f0c656d3-986d-4d62-98c0-1d15ec89804a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:25.038499 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f0c656d3-986d-4d62-98c0-1d15ec89804a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:25.095364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:25.095669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:25.097843 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f0c656d3-986d-4d62-98c0-1d15ec89804a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:25.101870 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:25.102358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:25.103207 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:25.103932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:25.104392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:25.104823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:25.106236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f0c656d3-986d-4d62-98c0-1d15ec89804a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1088 microversion: 2.1 time: 0.072707 Oct 04 08:51:25.107432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 277/578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:25 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:25.243195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:25.252314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f2c2c48e-53e1-4fcd-b369-e621ca913f7d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.161443 Oct 04 08:51:25.253032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 302/579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:25 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:25.490018 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:25.490788 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:25.498057 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:25.498542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:25.498979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:25.499668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:25.500149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:25.500575 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:25.645230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:25.654485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b7e9301d-f441-46ce-95df-d23ba9bd64ad tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.168433 Oct 04 08:51:25.655060 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 278/580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:25 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:26.128504 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:26.129119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:26.135165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:26.135643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:26.136076 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:26.136755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:26.137232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:26.138177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:26.199181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:26.207128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d38c3b29-f9bb-4581-8616-9162b8dd7f16 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1186 microversion: 2.1 time: 0.082744 Oct 04 08:51:26.207685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 303/581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:26 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:26.276616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:26.277236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:26.284189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:26.284668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:26.285095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:26.285810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:26.286263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:26.286675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:26.416431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:26.424561 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-59c49f0f-fe29-4c99-8e44-ae267255252c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.151851 Oct 04 08:51:26.425116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 279/582] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:26 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:26.680551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:26.681245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:26.687842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:26.688331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:26.688782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:26.689494 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:26.689980 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:26.690588 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:26.922304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:26.930867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ca83c79e-0fd2-481f-8ad9-4cbe815aeecd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.254270 Oct 04 08:51:26.931445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 304/583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:26 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:27.230608 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:27.231251 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:27.237054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:27.237539 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:27.238003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:27.238697 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:27.239154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:27.239581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:27.394865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:27.403989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5f8f9848-10ae-4827-aa91-276d55d1f36b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1271 microversion: 2.1 time: 0.177157 Oct 04 08:51:27.404619 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 280/584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:27 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:27.452056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:27.452782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:27.461278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:27.462238 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:27.462701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:27.463917 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:27.464540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:27.465146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:27.950266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:27.954514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:27.955210 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:27.961086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-07d6bce0-3c45-448e-bebd-b7fb6963dde2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.513679 Oct 04 08:51:27.961338 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:27.961662 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 305/585] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:27 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:27.961989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:27.962428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:27.963131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:27.963840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:27.964433 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:28.110607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:28.118780 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5189f18c-ba00-4318-b5cb-d016746cde9b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.168205 Oct 04 08:51:28.119349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 281/586] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:27 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:28.429302 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:28.430003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:28.437510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:28.438028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:28.438638 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:28.440425 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:28.441278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:28.441953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:28.494596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-7f419867-b7f8-4cee-894e-e7a84e5d46e9 req-671ad0be-5965-4a14-a5d8-5eb148ec6c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca2be3f-0f92-4726-a2cd-b4411b5a568d", "tag": "62e424ab-6247-49c9-940d-ec255b6199a8"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:28.504489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-7f419867-b7f8-4cee-894e-e7a84e5d46e9 req-671ad0be-5965-4a14-a5d8-5eb148ec6c2c service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:28.505459 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-7f419867-b7f8-4cee-894e-e7a84e5d46e9 req-671ad0be-5965-4a14-a5d8-5eb148ec6c2c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:28.506029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-7f419867-b7f8-4cee-894e-e7a84e5d46e9 req-671ad0be-5965-4a14-a5d8-5eb148ec6c2c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:28.518044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-7f419867-b7f8-4cee-894e-e7a84e5d46e9 req-671ad0be-5965-4a14-a5d8-5eb148ec6c2c service nova] Creating event network-changed:62e424ab-6247-49c9-940d-ec255b6199a8 for instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d on hv-cinder-86021 Oct 04 08:51:28.523408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-7f419867-b7f8-4cee-894e-e7a84e5d46e9 req-671ad0be-5965-4a14-a5d8-5eb148ec6c2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103919 Oct 04 08:51:28.524213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 306/587] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:28.584447 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:28.593044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cb223e94-2855-497c-b418-89c6c82cfac2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.168051 Oct 04 08:51:28.593604 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 282/588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:28 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:28.985581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:28.986309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:28.992568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:28.993076 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:28.993530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:28.994334 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:28.994790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:28.995235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:29.125983 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:29.134086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b2c65b57-630e-4a51-9934-d4222a6174a1 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.153308 Oct 04 08:51:29.134644 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 307/589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:28 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:29.143842 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:29.144455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:29.150556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:29.150975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:29.151410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:29.152091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:29.152540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:29.153600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:29.292142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:29.300363 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5fe1627f-fe7c-48c7-a6a8-6488ad38fa6e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.160285 Oct 04 08:51:29.300926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 283/590] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:29 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:29.616325 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:29.616972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:29.623880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:29.624354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:29.624787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:29.625461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:29.625956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:29.626374 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:29.755956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:29.763540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-bffe8574-b995-40e2-889f-5faa1222913b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.151037 Oct 04 08:51:29.764097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 308/591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:29 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:30.157828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:30.158442 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:30.164850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:30.165340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:30.165813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:30.166509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:30.166964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:30.167391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:30.300994 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:30.309234 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-93c6108b-b506-44e9-bed4-acec519508d4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.155331 Oct 04 08:51:30.309805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 284/592] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:30 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:30.323316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:30.324123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:30.330082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:30.330568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:30.331006 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:30.331695 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:30.332155 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:30.332579 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:30.483544 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:30.491713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-dbd6e9d1-2624-4120-a03d-bdbcfa7e46e8 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.172228 Oct 04 08:51:30.492280 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 309/593] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:30 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:30.786228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:30.786846 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:30.792750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:30.793231 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:30.794191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:30.794876 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:30.795333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:30.795758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:30.921219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:30.928820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-49e8879c-9b98-415f-be98-6e6694679540 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.146483 Oct 04 08:51:30.929385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 285/594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:30 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:31.332133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:31.332741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:31.339501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:31.339990 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:31.340429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:31.341120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:31.341574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:31.342037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:31.476763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:31.486125 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-bfe3fe4c-973e-4d53-ae01-1aad4b1c168c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.157972 Oct 04 08:51:31.486703 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 310/595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:31 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:31.515568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:31.516198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:31.522496 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:31.522975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:31.523409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:31.524094 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:31.524548 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:31.524973 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:31.666588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:31.675365 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e914a9db-74d5-4b02-b80b-14104285207a tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.163622 Oct 04 08:51:31.675933 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 286/596] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:31 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:31.951732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:31.952266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:31.958304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:31.958785 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:31.959222 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:31.959904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:31.960357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:31.960783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:32.088833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:32.097671 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9469398e-2292-4a06-9e72-162a0d33647d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.150237 Oct 04 08:51:32.098239 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 311/597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:31 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:32.509806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:32.510350 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:32.516254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:32.516820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:32.517139 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:32.517835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:32.518283 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:32.518700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:32.537307 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:32.647788 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:32.656603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-38ee4e25-92d8-43c1-807f-0a27f5f54660 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.150641 Oct 04 08:51:32.657215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 287/598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:32 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:32.698198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:32.698833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:32.705242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:32.705745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:32.706179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:32.706860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:32.707307 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:32.707730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:32.850912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:32.859075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6b1a4471-83a8-466a-8e41-59ad4b5f7e3c tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.164717 Oct 04 08:51:32.859581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 312/599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:32 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:33.119573 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:33.120107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:33.126515 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:33.126994 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:33.127425 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:33.128107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:33.128556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:33.128979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:33.253951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:33.261502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-dd059ae5-b056-482b-b15e-9c9a818af079 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.145909 Oct 04 08:51:33.262710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 288/600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:33 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:33.680375 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:33.681020 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:33.687682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:33.688165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:33.688597 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:33.689274 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:33.689746 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:33.690167 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:33.815090 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:33.823284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5da15963-a557-4a68-a94c-d4763c84741d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.146816 Oct 04 08:51:33.823853 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 313/601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:33 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:33.881791 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:33.882456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:33.889665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:33.890176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:33.890615 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:33.891310 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:33.891764 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:33.892223 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:34.036192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:34.044319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3ccbd36e-96ea-4555-9447-94a316daec04 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.166436 Oct 04 08:51:34.044880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 289/602] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:33 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:34.284532 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:34.285077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:34.290954 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:34.291430 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:34.291861 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:34.292536 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:34.293010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:34.293958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:34.422293 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:34.429544 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c2543f16-b417-47a6-981d-6a85c98707fb tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.148957 Oct 04 08:51:34.430137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 314/603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:34 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:34.846924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:34.847533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:34.853718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:34.854208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:34.854674 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:34.855398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:34.856513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:34.856941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:34.987253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:34.995414 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-35372914-b640-43ef-8e26-2856089fb63b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.152356 Oct 04 08:51:34.995962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 290/604] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:34 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:35.067760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:35.068370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:35.070881 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:35.071565 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:35.078096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:35.078599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:35.079033 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:35.079717 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:35.080166 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:35.080589 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:35.227430 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:35.235580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fc898303-c953-4d4f-bf81-fe62fa346ba2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.171834 Oct 04 08:51:35.236140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 315/605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:35 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:35.452915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:35.453517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:35.455359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:35.460761 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:35.461245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:35.461683 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:35.462426 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:35.462881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:35.463570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:35.595665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:35.603186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-09439f72-afd6-4fa9-ad74-4a54ad350da5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.154786 Oct 04 08:51:35.603745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 291/606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:35 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:36.018560 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.019170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:36.025069 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:36.025534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:36.025998 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:36.026680 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:36.027130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:36.028164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:36.155657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:36.163871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7ce57a57-ce2f-4ad3-bb26-72b786260cb4 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.149151 Oct 04 08:51:36.164444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 316/607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:36 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:36.258235 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.258841 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:36.265863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:36.266336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:36.266763 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:36.267440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:36.267891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:36.268306 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:36.405754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:36.413909 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d79a9c15-5618-418c-a6dc-7f174ba7461b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.159531 Oct 04 08:51:36.414476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 292/608] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:36 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:36.625673 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:36.626307 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:36.632168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:36.632645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:36.633076 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:36.633782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:36.634232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:36.634650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:36.764614 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:36.772238 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2150ec8f-1be7-4513-8836-bf0633488929 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.150977 Oct 04 08:51:36.772806 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 317/609] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:36 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:37.186753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:37.187356 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:37.193236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:37.193737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:37.194167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:37.194868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:37.195315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:37.195729 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:37.323775 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:37.332458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ca0a07fa-c665-4f6c-a8e8-ff8236a4c9a0 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.149617 Oct 04 08:51:37.333029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 293/610] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:37 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:37.436852 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:37.437377 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:37.443722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:37.444202 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:37.444636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:37.445321 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:37.445799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:37.446225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:37.448719 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:37.587131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:37.596340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6209db07-3251-468a-9c42-2f732d81aec0 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.163363 Oct 04 08:51:37.596943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 318/611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:37 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:37.794008 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:37.794624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:37.800632 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:37.801122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:37.801560 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:37.802275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:37.802732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:37.803154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:37.930464 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:37.938798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-47a6f7d3-cb35-4c9d-b662-c5bb37a30b50 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.148787 Oct 04 08:51:37.939366 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 294/612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:37 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:38.356199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:38.356784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:38.362667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:38.363141 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:38.363600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:38.364278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:38.364724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:38.365141 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:38.496126 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:38.504349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-65a9c96b-a5bc-48c7-af88-2992784f0c69 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.152669 Oct 04 08:51:38.504921 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 319/613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:38 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:38.620397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:38.620926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:38.627309 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:38.627805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:38.628236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:38.628913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:38.629363 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:38.629808 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:38.767979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:38.776325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-02c2d81b-2fe6-4e19-a2d9-a7bb7d37f5a4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.159867 Oct 04 08:51:38.777227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 295/614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:38 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:38.962072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:38.962600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:38.969237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:38.969743 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:38.970182 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:38.970865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:38.971314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:38.971730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:39.104470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:39.112216 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0916106d-63fd-46d5-b09f-900813aee207 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.154103 Oct 04 08:51:39.112786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 320/615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:38 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:39.527250 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:39.528451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:39.534306 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:39.534779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:39.535206 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:39.535884 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:39.536330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:39.536743 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:39.665155 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:39.673376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5ae13510-a17c-4843-877b-77375e195fee tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.150027 Oct 04 08:51:39.673965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 296/616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:39 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:39.800266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:39.800799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:39.807166 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:39.807650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:39.808085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:39.808772 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:39.809265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:39.809710 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:39.953711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:39.961971 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e26e9eb4-a3ea-4383-8d81-8aa539b06598 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.165637 Oct 04 08:51:39.962541 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 321/617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:39 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:40.135242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:40.135853 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:40.142430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:40.142902 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:40.143333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:40.144011 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:40.144458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:40.144872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:40.272621 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:40.280253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3d952535-f213-43b7-8bfe-148e49943461 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.148938 Oct 04 08:51:40.280815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 297/618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:40 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:40.696330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:40.696931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:40.703233 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-935ee4d4-059f-4cee-b262-c6e51efb5e85 req-7bd8a783-f7b6-4fb2-aeb4-2298cae9e12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2be3f-0f92-4726-a2cd-b4411b5a568d", "name": "network-vif-plugged", "status": "completed", "tag": "62e424ab-6247-49c9-940d-ec255b6199a8"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:40.703663 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:40.704158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:40.704590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:40.705481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:40.705958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:40.706379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:40.715308 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-935ee4d4-059f-4cee-b262-c6e51efb5e85 req-7bd8a783-f7b6-4fb2-aeb4-2298cae9e12b service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:40.715796 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-935ee4d4-059f-4cee-b262-c6e51efb5e85 req-7bd8a783-f7b6-4fb2-aeb4-2298cae9e12b service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:40.716252 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-935ee4d4-059f-4cee-b262-c6e51efb5e85 req-7bd8a783-f7b6-4fb2-aeb4-2298cae9e12b service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:40.727764 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-935ee4d4-059f-4cee-b262-c6e51efb5e85 req-7bd8a783-f7b6-4fb2-aeb4-2298cae9e12b service nova] Creating event network-vif-plugged:62e424ab-6247-49c9-940d-ec255b6199a8 for instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d on hv-cinder-86021 Oct 04 08:51:40.733408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-935ee4d4-059f-4cee-b262-c6e51efb5e85 req-7bd8a783-f7b6-4fb2-aeb4-2298cae9e12b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090367 Oct 04 08:51:40.734091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 322/619] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:51:40.837502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:40.846493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c0af3a63-7ab3-4432-9911-2ad99d1dd04b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.154133 Oct 04 08:51:40.847057 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 298/620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:40 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:40.985596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:40.986319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:40.992877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:40.993347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:40.993813 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:40.994489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:40.994936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:40.995352 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:41.137885 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:41.146031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-26873f0d-0409-46fe-9abd-3fcede104faa tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.164612 Oct 04 08:51:41.146598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 323/621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:40 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:41.303024 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:41.303631 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:41.309470 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:41.309982 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:41.310401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:41.311074 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:41.311523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:41.311940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:41.441909 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:41.450842 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d2c569b2-1854-41af-a47c-8f11d381cdf2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.151598 Oct 04 08:51:41.451437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 299/622] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:41 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:41.869300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:41.869973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:41.876641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:41.877115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:41.877546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:41.878264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:41.878716 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:41.879137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:42.005213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:42.013425 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a3ebfa80-d902-4119-9a26-ac3fb88f6778 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.148010 Oct 04 08:51:42.014021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 324/623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:41 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:42.170387 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:42.170999 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:42.177091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:42.177573 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:42.178045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:42.178726 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:42.179177 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:42.179599 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:42.317197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:42.325988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-dddf18c9-88ec-4eee-baf6-a45d59496c88 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.160240 Oct 04 08:51:42.326562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 300/624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:42 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:42.473275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:42.473908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:42.479810 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:42.480791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:42.481218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:42.481936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:42.482384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:42.482800 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:42.612946 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:42.620473 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5857a1e6-5466-4e85-ba2e-a09b60628a86 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.151077 Oct 04 08:51:42.621674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 325/625] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:42 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:43.036628 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:43.037241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:43.043946 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:43.044428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:43.044862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:43.045550 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:43.046027 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:43.046500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:43.176369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:43.184900 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1942d16e-0cff-460e-a19e-6b5c4c52fd14 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1735 microversion: 2.1 time: 0.152271 Oct 04 08:51:43.185441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 301/626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:43 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:43.349256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:43.349890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:43.356443 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:43.356923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:43.357353 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:43.358067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:43.358517 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:43.358936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:43.495142 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:43.503496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-382beb35-b9e8-4915-83f1-ef3a0900bf94 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1757 microversion: 2.1 time: 0.158276 Oct 04 08:51:43.504059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 326/627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:43 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:43.643542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:43.644099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:43.649917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:43.650395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:43.650821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:43.651494 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:43.651935 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:43.652414 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:43.779917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:43.787528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-95424b9a-8e90-4c7c-a0c2-9c56393ffe20 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.147840 Oct 04 08:51:43.788086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 302/628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:43 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:44.207685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:44.208298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:44.214431 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.214912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.215342 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.216031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.216479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.216899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.342886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:44.351534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d9f37a7d-cde6-4f07-b726-f2aab1d5163e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1715 microversion: 2.1 time: 0.147638 Oct 04 08:51:44.352227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 327/629] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:44 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:44.412806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:44.413275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:44.420315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.420785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.421210 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.421942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.422389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.422806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.526894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:44.527509 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:44.534067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.534561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.534998 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.535752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.536210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.536633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.544899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] HTTP exception thrown: Cannot 'detach_volume' instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d while it is in vm_state rescued Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Request method failure captured: Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: DELETE /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments/71da5d61-c693-4867-8f1c-8be30289906d HTTP/1.1 Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LFl7xKXNfF9BfAgAnIN4w4ISqldMi8hBBZcCI7rcHZibCN8zsPrTIGBG6JnFl3MtYZHlNjdg42i7uQb2P5Ypp6OhGpYoVd4S0aChqIAhnHQ8t59fylgmlx_HVA1GNV9w92vrqm4HmQGY0tm-Vt1sHFUvt-kg6M82-7GNA-5KG5mxI Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:51:44.546510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b7703aae5634dabb496bc221882863c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b7703aae5634dabb496bc221882863c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}] Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: acf57eb971eb4f78b173a5ab47160bd1 Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:51:44.548135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Cannot 'detach_volume' instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d while it is in vm_state rescued Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'server_id': '0b2c9f68-135f-4233-ab6b-497b6be10b2d', 'id': '71da5d61-c693-4867-8f1c-8be30289906d'} Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:44.549084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d while it is in vm_state rescued Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d while it is in vm_state rescued Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:51:44.550671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Returning 409 to user: Cannot 'detach_volume' instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d while it is in vm_state rescued {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:44.551861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-739736b4-d091-464c-9271-e4232297d07b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments/71da5d61-c693-4867-8f1c-8be30289906d" status: 409 len: 152 microversion: 2.1 time: 0.139089 Oct 04 08:51:44.552107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 303/630] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 08:51:44 2022] DELETE /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments/71da5d61-c693-4867-8f1c-8be30289906d => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 08:51:44.556653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:44.557173 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:44.564010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.564486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.564916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.565595 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.566072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.566492 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.570908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:44.632247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-aeb5e431-dcf4-4fb1-a144-dfcb12f72a0b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "POST /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.078909 Oct 04 08:51:44.635805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 304/631] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:51:44 2022] POST /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:51:44.641760 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:44.642458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:44.648394 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.648879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.649309 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.650043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.650487 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.650911 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.686761 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:44.695161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-725a26df-a864-4535-882b-a580a184d50d tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1760 microversion: 2.1 time: 0.172020 Oct 04 08:51:44.695741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 328/632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:44 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:44.782221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:44.790269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-05e0b40b-1597-40af-bf98-e3c6512ceb24 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1723 microversion: 2.1 time: 0.152534 Oct 04 08:51:44.790822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 305/633] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:44 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:51:44.810412 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:44.811024 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:44.816838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.817320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.817789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.818512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:44.818969 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:44.819395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:44.945783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:44.953393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ecf8a436-b6d7-49ec-9e00-f83a17217f7a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1259 microversion: 2.1 time: 0.147518 Oct 04 08:51:44.953987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 329/634] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:44 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:45.813200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:45.813828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:45.820168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:45.820645 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:45.821070 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:45.821765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:45.822211 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:45.822627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:45.945804 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:45.953956 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6219cff5-44ac-48a9-b3df-6054a3ea3caf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1723 microversion: 2.1 time: 0.144549 Oct 04 08:51:45.954510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 306/635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:45 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:45.976178 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:45.976793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:45.984162 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:45.984643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:45.985073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:45.985778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:45.986228 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:45.986642 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:46.123280 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:46.131053 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7488bb3d-cc4e-4245-9e95-15de0f4cdcc5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1443 microversion: 2.1 time: 0.158701 Oct 04 08:51:46.131629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 330/636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:45 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:46.155229 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:46.155843 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:46.162144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:46.162649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:46.163072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:46.163799 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:46.164259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:46.164711 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:46.304305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:46.313458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-348cfc44-57e2-4d8a-9762-5aafafd87528 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1443 microversion: 2.1 time: 0.161981 Oct 04 08:51:46.314485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 307/637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:46 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:46.979476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:46.980647 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:46.987811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:46.988396 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:46.988897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:46.989892 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:46.990416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:46.991079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:47.207465 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:47.217282 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fe2e20a9-9fd9-4057-bf2d-182571c48a5d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1723 microversion: 2.1 time: 0.243201 Oct 04 08:51:47.217977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 331/638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:46 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:48.239735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-729bdf4c-5cf2-448f-9ee3-1210ad5c674f req-d97d1441-d055-4fcf-8a02-5f69d9b2059a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca2be3f-0f92-4726-a2cd-b4411b5a568d", "tag": "62e424ab-6247-49c9-940d-ec255b6199a8"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:48.241142 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:48.241775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:48.249794 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-729bdf4c-5cf2-448f-9ee3-1210ad5c674f req-d97d1441-d055-4fcf-8a02-5f69d9b2059a service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:48.250291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-729bdf4c-5cf2-448f-9ee3-1210ad5c674f req-d97d1441-d055-4fcf-8a02-5f69d9b2059a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:48.251005 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-729bdf4c-5cf2-448f-9ee3-1210ad5c674f req-d97d1441-d055-4fcf-8a02-5f69d9b2059a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:48.256545 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:48.257030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:48.257464 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:48.258183 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:48.258634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:48.259052 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:48.262283 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-729bdf4c-5cf2-448f-9ee3-1210ad5c674f req-d97d1441-d055-4fcf-8a02-5f69d9b2059a service nova] Creating event network-changed:62e424ab-6247-49c9-940d-ec255b6199a8 for instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d on hv-cinder-86021 Oct 04 08:51:48.267320 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-729bdf4c-5cf2-448f-9ee3-1210ad5c674f req-d97d1441-d055-4fcf-8a02-5f69d9b2059a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085967 Oct 04 08:51:48.268157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 308/639] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:48.399004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:48.407355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-78bf47ae-754f-4a58-8e7c-b8683e49368c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1723 microversion: 2.1 time: 0.169950 Oct 04 08:51:48.407934 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 332/640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:48 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:49.430461 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:49.431149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:49.437146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:49.437618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:49.438110 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:49.438790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:49.439265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:49.439680 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:49.570511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:49.579040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-83552468-3358-43b2-af57-59c8072f7d71 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1723 microversion: 2.1 time: 0.153478 Oct 04 08:51:49.579587 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 309/641] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:49 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:50.602954 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:50.603553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:50.609984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.610463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.610895 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.611580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.612029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.612449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.739105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:51:50.747953 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-50bbb3c5-72d0-420c-afa5-dd4c8a3cffa2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1729 microversion: 2.1 time: 0.148925 Oct 04 08:51:50.748514 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 333/642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:51:50 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:51:50.769669 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:50.770195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:51:50.776504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.777017 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.777457 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.778177 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:50.778634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:50.779064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:50.857730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f4af1102-0355-4a69-b772-79194da95f8d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091789 Oct 04 08:51:50.858517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 310/643] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 08:51:50 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:51.717534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-73186987-9bb8-4c8f-8d7c-696ede287341 req-9f2117bc-62e7-453f-94c8-838b3d3a5c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2c9f68-135f-4233-ab6b-497b6be10b2d", "tag": "a438852b-8790-40e5-aff4-07d0c3a3ad41"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:51.730813 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-73186987-9bb8-4c8f-8d7c-696ede287341 req-9f2117bc-62e7-453f-94c8-838b3d3a5c49 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:51.731683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-73186987-9bb8-4c8f-8d7c-696ede287341 req-9f2117bc-62e7-453f-94c8-838b3d3a5c49 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:51.732484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-73186987-9bb8-4c8f-8d7c-696ede287341 req-9f2117bc-62e7-453f-94c8-838b3d3a5c49 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:51.747234 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-73186987-9bb8-4c8f-8d7c-696ede287341 req-9f2117bc-62e7-453f-94c8-838b3d3a5c49 service nova] Creating event network-changed:a438852b-8790-40e5-aff4-07d0c3a3ad41 for instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d on hv-cinder-86021 Oct 04 08:51:51.753122 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-73186987-9bb8-4c8f-8d7c-696ede287341 req-9f2117bc-62e7-453f-94c8-838b3d3a5c49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039207 Oct 04 08:51:51.754649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 334/644] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:51:53.768379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-481e2760-696c-463b-9a06-1de80444b24f req-8e913eab-b438-4642-bd00-cc11798e6719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2c9f68-135f-4233-ab6b-497b6be10b2d", "tag": "a438852b-8790-40e5-aff4-07d0c3a3ad41"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:53.773248 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=79 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:53.779048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-481e2760-696c-463b-9a06-1de80444b24f req-8e913eab-b438-4642-bd00-cc11798e6719 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:53.779513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-481e2760-696c-463b-9a06-1de80444b24f req-8e913eab-b438-4642-bd00-cc11798e6719 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:53.779935 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-481e2760-696c-463b-9a06-1de80444b24f req-8e913eab-b438-4642-bd00-cc11798e6719 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:53.790837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-481e2760-696c-463b-9a06-1de80444b24f req-8e913eab-b438-4642-bd00-cc11798e6719 service nova] Creating event network-changed:a438852b-8790-40e5-aff4-07d0c3a3ad41 for instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d on hv-cinder-86021 Oct 04 08:51:53.796286 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-481e2760-696c-463b-9a06-1de80444b24f req-8e913eab-b438-4642-bd00-cc11798e6719 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032101 Oct 04 08:51:53.796926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 311/645] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:01.622740 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:01.623323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:01.625246 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:01.631021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.631507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.631972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.632692 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.633145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.633568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.657823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f5a5d5d3-d6be-44fc-bc3b-2a4c13ff8fa1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e/ips" status: 200 len: 149 microversion: 2.1 time: 0.138541 Oct 04 08:52:01.658381 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 335/646] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:52:01 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e/ips => generated 149 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:01.671914 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c35f4d4-d4f7-4085-901c-6666f30e16df"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:01.674338 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:01.680378 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.680850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.681277 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.681988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.682434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.682851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.760551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Invalid volume: volume 5c35f4d4-d4f7-4085-901c-6666f30e16df is already attached to instances: 7b03cac8-950a-405e-b19b-90a962f5c73f Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: POST /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e/os-volume_attachments HTTP/1.1 Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 74 Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:52:01.762296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {"volumeAttachment": {"volumeId": "5c35f4d4-d4f7-4085-901c-6666f30e16df"}} Oct 04 08:52:01.763861 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Invalid volume: volume 5c35f4d4-d4f7-4085-901c-6666f30e16df is already attached to instances: 7b03cac8-950a-405e-b19b-90a962f5c73f Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'server_id': 'b39d3753-4068-45e1-bf8c-1e7b4002137e', 'body': {'volumeAttachment': {'volumeId': '5c35f4d4-d4f7-4085-901c-6666f30e16df'}}} Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5c35f4d4-d4f7-4085-901c-6666f30e16df is already attached to instances: 7b03cac8-950a-405e-b19b-90a962f5c73f Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:52:01.764790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5c35f4d4-d4f7-4085-901c-6666f30e16df is already attached to instances: 7b03cac8-950a-405e-b19b-90a962f5c73f Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:01.766297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5c35f4d4-d4f7-4085-901c-6666f30e16df is already attached to instances: 7b03cac8-950a-405e-b19b-90a962f5c73f Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 400 to user: Invalid volume: volume 5c35f4d4-d4f7-4085-901c-6666f30e16df is already attached to instances: 7b03cac8-950a-405e-b19b-90a962f5c73f {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-821d1ea8-764f-4ab7-bcac-900bd9c9b144 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097510 Oct 04 08:52:01.767889 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 312/647] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:52:01 2022] POST /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:52:01.772643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:01.773151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:01.779653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.780084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.780522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.781206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.781664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.782128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.797103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:01.807838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:52:01.884386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a42bd747-ffd7-4d52-a69f-1f86c2670ed7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 204 len: 0 microversion: 2.1 time: 0.115233 Oct 04 08:52:01.885269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 336/648] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:52:01 2022] DELETE /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:52:01.894768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:01.895373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:01.902430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.902904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.903329 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:01.904009 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:01.904453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:01.904869 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:02.033493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:02.041126 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e33f4e30-fb49-4a62-a633-92832c5df3ff tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1681 microversion: 2.1 time: 0.151516 Oct 04 08:52:02.041819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 313/649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:01 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:03.065221 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:03.065970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:03.072263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:03.072768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:03.073205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:03.073916 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:03.074372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:03.074797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:03.207860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:03.216322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ece01c29-3e58-419a-bad3-489faf66671d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1681 microversion: 2.1 time: 0.155356 Oct 04 08:52:03.216878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 337/650] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:03 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:04.240368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:04.241014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:04.248770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.249122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.249289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.250016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.250468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.250890 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.380373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:04.388067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4d333ed0-3ac7-4ae4-8ec3-0d3afe4eea19 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1681 microversion: 2.1 time: 0.151553 Oct 04 08:52:04.388630 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 314/651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:04 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:04.938487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-059ab719-7f19-49bd-bf02-baaa5f4e8f3b req-34990cc9-ea96-46cd-9ff3-a77ae07d22fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39d3753-4068-45e1-bf8c-1e7b4002137e", "name": "network-vif-deleted", "tag": "2dffcb18-03be-456f-8c81-d846f5771bf0"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:04.948621 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-059ab719-7f19-49bd-bf02-baaa5f4e8f3b req-34990cc9-ea96-46cd-9ff3-a77ae07d22fb service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:04.949224 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-059ab719-7f19-49bd-bf02-baaa5f4e8f3b req-34990cc9-ea96-46cd-9ff3-a77ae07d22fb service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:04.949662 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-059ab719-7f19-49bd-bf02-baaa5f4e8f3b req-34990cc9-ea96-46cd-9ff3-a77ae07d22fb service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:04.962109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-059ab719-7f19-49bd-bf02-baaa5f4e8f3b req-34990cc9-ea96-46cd-9ff3-a77ae07d22fb service nova] Creating event network-vif-deleted:2dffcb18-03be-456f-8c81-d846f5771bf0 for instance b39d3753-4068-45e1-bf8c-1e7b4002137e on hv-cinder-86021 Oct 04 08:52:04.968026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-059ab719-7f19-49bd-bf02-baaa5f4e8f3b req-34990cc9-ea96-46cd-9ff3-a77ae07d22fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033176 Oct 04 08:52:04.968717 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 338/652] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:05.411602 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:05.412150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:05.423484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.424013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.424482 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.425207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.425666 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.426121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.461474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:05.462010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:05.462719 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:05.463195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'fault' on Instance uuid b39d3753-4068-45e1-bf8c-1e7b4002137e {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:52:05.505288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:05.513639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0d08ea04-3e10-4c2b-a819-de272df0f891 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 200 len: 1332 microversion: 2.1 time: 0.106306 Oct 04 08:52:05.514490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 315/653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:05 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:06.537819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:06.538521 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:06.544595 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:06.545064 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:06.545489 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:06.546216 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:06.546664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:06.547078 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:06.559918 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e HTTP/1.1 Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:52:06.561496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:52:06.563156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'b39d3753-4068-45e1-bf8c-1e7b4002137e'} Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:52:06.563963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:52:06.565230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:06.566389 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:52:06.566389 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-deefc75e-82c0-4cb4-92eb-2600491e9d27 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 404 len: 111 microversion: 2.1 time: 0.029757 Oct 04 08:52:06.566389 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 339/654] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:06 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:52:06.571533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b2ab808a-5702-46ba-9946-936043e5862b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '.version_select at 0x7f5fd42b3e50>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:06.592205 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b2ab808a-5702-46ba-9946-936043e5862b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475675612" status: 202 len: 0 microversion: 2.1 time: 0.024348 Oct 04 08:52:06.592976 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 316/655] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 08:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475675612 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:52:07.264080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:07.264574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:07.270574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.271061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.271500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.272192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.272647 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.273087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.396253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'services' on Instance uuid 7b03cac8-950a-405e-b19b-90a962f5c73f {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:52:07.505874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3dcf3df4-303a-4f70-a6ac-5aa6ffcbaedf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments/5c35f4d4-d4f7-4085-901c-6666f30e16df" status: 202 len: 0 microversion: 2.1 time: 0.245546 Oct 04 08:52:07.506455 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 340/656] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 08:52:07 2022] DELETE /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments/5c35f4d4-d4f7-4085-901c-6666f30e16df => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:52:07.515267 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:07.517430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:07.523957 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.524402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.524931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.526468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:07.526926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:07.527529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:07.555731 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9abebd83-aeca-43e0-bbd1-d39c4bd1d2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Oct 04 08:52:07.556287 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 317/657] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:52:07 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:08.569101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:08.571442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:08.577970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:08.578448 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:08.578879 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:08.579566 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:08.580014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:08.580432 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:08.613833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cdc8b687-b1b3-4245-a509-b6bd6ce614d0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049024 Oct 04 08:52:08.614380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 341/658] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:52:08 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:09.626753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:09.628946 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:09.635199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.635669 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.636096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.636768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.637213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.637631 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.667818 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-278eaa58-a39c-48bd-8c04-0e1b57f20855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044941 Oct 04 08:52:09.668366 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 318/659] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:52:09 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:52:09.729562 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:09.730099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:09.736440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.736924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.737361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.738077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.738529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.738951 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.763516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:52:09.835258 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2adba2c9-8a16-4e5d-bf63-82d6183937c3 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 204 len: 0 microversion: 2.1 time: 0.109890 Oct 04 08:52:09.836014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 342/660] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:52:09 2022] DELETE /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:52:09.844767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:09.845374 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:09.851242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.851709 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.852141 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.852826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:09.853273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:09.853787 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:09.984373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:09.991931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-14b65c79-6267-464f-8ff5-824ef65bd4a0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1682 microversion: 2.1 time: 0.150998 Oct 04 08:52:09.992486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 319/661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:09 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:11.015354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:11.015980 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:11.022274 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:11.022758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:11.023192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:11.023882 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:11.024333 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:11.024759 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:11.153561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:11.161273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1ee51fe5-8629-4cf1-ae55-ebded146b6df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1682 microversion: 2.1 time: 0.150265 Oct 04 08:52:11.161876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 343/662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:11 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:12.184641 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:12.185288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:12.191694 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:12.192183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:12.192616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:12.193321 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:12.193801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:12.194226 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:12.264312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:12.273005 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-755576f2-d648-4ff6-b7fd-4160ec17ba7b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1614 microversion: 2.1 time: 0.092239 Oct 04 08:52:12.273597 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 320/663] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:12 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:12.493272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-3eb36a25-32a2-45e1-b6ed-cd1fa604fa6d req-9c92dcce-4b53-4fc5-9338-07a2de9d0ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b03cac8-950a-405e-b19b-90a962f5c73f", "name": "network-vif-deleted", "tag": "615440bd-a86a-4725-9efe-5cc93f1f22d9"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:12.503992 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-3eb36a25-32a2-45e1-b6ed-cd1fa604fa6d req-9c92dcce-4b53-4fc5-9338-07a2de9d0ff9 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:12.504755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-3eb36a25-32a2-45e1-b6ed-cd1fa604fa6d req-9c92dcce-4b53-4fc5-9338-07a2de9d0ff9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:12.505171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-3eb36a25-32a2-45e1-b6ed-cd1fa604fa6d req-9c92dcce-4b53-4fc5-9338-07a2de9d0ff9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:12.517097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-3eb36a25-32a2-45e1-b6ed-cd1fa604fa6d req-9c92dcce-4b53-4fc5-9338-07a2de9d0ff9 service nova] Creating event network-vif-deleted:615440bd-a86a-4725-9efe-5cc93f1f22d9 for instance 7b03cac8-950a-405e-b19b-90a962f5c73f on hv-cinder-86021 Oct 04 08:52:12.522241 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-3eb36a25-32a2-45e1-b6ed-cd1fa604fa6d req-9c92dcce-4b53-4fc5-9338-07a2de9d0ff9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032745 Oct 04 08:52:12.523353 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 344/664] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:13.296575 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:13.297332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:13.304236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:13.304717 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:13.305220 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:13.306005 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:13.306473 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:13.306971 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:13.342864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:13.343343 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:13.343770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:13.344219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'fault' on Instance uuid 7b03cac8-950a-405e-b19b-90a962f5c73f {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:52:13.390455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:13.394956 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:13.402550 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-acf8245f-c3ee-46c8-a22f-96f08598f9b6 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 200 len: 1331 microversion: 2.1 time: 0.109597 Oct 04 08:52:13.403135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 321/665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:13 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:14.428735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:14.429449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:14.435605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.436086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.436524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.437237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.437711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.438140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.451204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f HTTP/1.1 Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:52:14.452789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:52:14.454370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '7b03cac8-950a-405e-b19b-90a962f5c73f'} Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:52:14.455174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:52:14.456516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:14.457923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:52:14.457923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-763601d4-ee06-46d6-8c05-e0cb49657d50 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 404 len: 111 microversion: 2.1 time: 0.030494 Oct 04 08:52:14.457923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 345/666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:14 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:52:14.463611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e5fed610-3739-4f74-9f3d-83efaf59d583 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '.version_select at 0x7f5fd42f9670>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:14.483489 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e5fed610-3739-4f74-9f3d-83efaf59d583 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814708181" status: 202 len: 0 microversion: 2.1 time: 0.024355 Oct 04 08:52:14.484054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 322/667] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 4 08:52:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814708181 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:52:15.093070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-46a6f50a-1612-4d6b-9cc2-aa5a9f48bdd1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: .version_select at 0x7f5fd41c1820>, body: {"keypair": {"name": "tempest-keypair-1707279528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlTm8YZQD48k+zXkezxWv3JNj4PNmqUeoMLJ1fr6DYrqyIs85qpaoWYPSh6MZ4n/0u/meHSXgAai/5zkjT/GymNpwQ4Lu6t/WQs2Lmbl4wEaqvw5C4BB35J84iNSXg0zw=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:15.108172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-46a6f50a-1612-4d6b-9cc2-aa5a9f48bdd1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:15.112014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-46a6f50a-1612-4d6b-9cc2-aa5a9f48bdd1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:15.133730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-46a6f50a-1612-4d6b-9cc2-aa5a9f48bdd1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045555 Oct 04 08:52:15.134316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 346/668] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:52:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:16.312459 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1724498414", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbaa5ae-9515-4efe-ae61-91971a7f125f"}], "security_groups": [{"name": "tempest-securitygroup--1047134044"}], "key_name": "tempest-keypair-1707279528", "user_data": "}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:16.414153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] validate_networks() for [('fbbaa5ae-9515-4efe-ae61-91971a7f125f', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:52:16.815711 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:52:16.816135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:52:16.816609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:52:16.817018 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:52:16.817427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:52:16.826068 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.826546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.826979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.827702 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:16.828150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:16.828575 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:16.845384 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:16.849276 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:16.860670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:52:16.863089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:52:16.908767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-200942be-7723-45be-9a90-ad3b93d6607a tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.600672 Oct 04 08:52:16.909440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 323/669] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:52:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:52:16.921253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3ff9e8e1-4beb-4459-a1a6-dc77a1f5bb57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:16.921940 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3ff9e8e1-4beb-4459-a1a6-dc77a1f5bb57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:16.982338 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3ff9e8e1-4beb-4459-a1a6-dc77a1f5bb57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.990075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3ff9e8e1-4beb-4459-a1a6-dc77a1f5bb57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1242 microversion: 2.1 time: 0.072640 Oct 04 08:52:16.990636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 347/670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:16 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:18.012948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:18.013497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:18.020332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.020813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.021247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.021959 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.022412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.022837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.082700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:18.091125 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1354de97-910f-45f3-a0cf-c144c0bbc230 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1294 microversion: 2.1 time: 0.082724 Oct 04 08:52:18.091688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 324/671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:18 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:19.114809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:19.115528 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:19.122551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:19.123240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:19.123859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:19.124761 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:19.125213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:19.125634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:19.370466 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.378184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ab71355c-eda6-436f-ab4a-d60921f9b563 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.267522 Oct 04 08:52:19.378748 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 348/672] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:19 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:19.815710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-bd5d3e66-9520-4469-b9b9-45b23f987814 req-86324ab2-dc4f-467f-940c-7bf9b70b6a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8d2b2f-7930-42d6-b6d3-5f7a282bd723", "tag": "6c158308-7224-4932-8a58-e9d0bdf454eb"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:19.826720 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-bd5d3e66-9520-4469-b9b9-45b23f987814 req-86324ab2-dc4f-467f-940c-7bf9b70b6a55 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:19.827291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-bd5d3e66-9520-4469-b9b9-45b23f987814 req-86324ab2-dc4f-467f-940c-7bf9b70b6a55 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:19.827796 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-bd5d3e66-9520-4469-b9b9-45b23f987814 req-86324ab2-dc4f-467f-940c-7bf9b70b6a55 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:19.839611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-bd5d3e66-9520-4469-b9b9-45b23f987814 req-86324ab2-dc4f-467f-940c-7bf9b70b6a55 service nova] Creating event network-changed:6c158308-7224-4932-8a58-e9d0bdf454eb for instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 on hv-cinder-86021 Oct 04 08:52:19.844362 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-bd5d3e66-9520-4469-b9b9-45b23f987814 req-86324ab2-dc4f-467f-940c-7bf9b70b6a55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032956 Oct 04 08:52:19.844944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 325/673] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:20.400894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:20.401494 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:20.407778 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.408255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.408684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.409362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.409835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.410255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.536458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.544700 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3d77ff3b-d8ec-4d58-9e68-67040b0b2ff0 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.148254 Oct 04 08:52:20.545256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 349/674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:20 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:21.567292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:21.567989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:21.574187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.574665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.575097 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.575777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.576224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.576644 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.706073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.713918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-76325899-1943-4da0-a8e0-56d2e680fb9d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.151342 Oct 04 08:52:21.714476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 326/675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:21 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:22.736746 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:22.737354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:22.744000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.744484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.744944 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.745627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.746107 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.746523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.873254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.880839 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e6b1217e-14d8-4c05-a252-e2eea9876411 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.147971 Oct 04 08:52:22.881422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 350/676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:22 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:23.903982 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:23.904594 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:23.907056 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:23.912172 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.912654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.913083 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.913798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.914249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.914671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:24.043691 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.051181 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d1b6c06f-23fd-4fb4-ba56-dd0d112ade85 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.151715 Oct 04 08:52:24.051745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 327/677] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:23 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:25.074237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:25.074850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:25.081205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.081715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.082175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.082865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.083319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.083744 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.215104 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.222669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-115b0316-5fc0-4681-a303-dad009f9fd08 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.152341 Oct 04 08:52:25.223229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 351/678] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:25 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:26.246017 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:26.246654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:26.253020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.253497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.253965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.254648 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.255317 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.255505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.389499 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.397251 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0fb39116-6c49-465a-b46e-f174a1cc372c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.155160 Oct 04 08:52:26.397837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 328/679] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:26 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:26.925454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-423aa3eb-e36c-4bf6-aea0-93e6678b3b7c req-51fe8651-7632-44d8-860f-75f3b8b9c056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8d2b2f-7930-42d6-b6d3-5f7a282bd723", "name": "network-vif-plugged", "status": "completed", "tag": "6c158308-7224-4932-8a58-e9d0bdf454eb"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:26.935959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-423aa3eb-e36c-4bf6-aea0-93e6678b3b7c req-51fe8651-7632-44d8-860f-75f3b8b9c056 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.936444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-423aa3eb-e36c-4bf6-aea0-93e6678b3b7c req-51fe8651-7632-44d8-860f-75f3b8b9c056 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.936879 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-423aa3eb-e36c-4bf6-aea0-93e6678b3b7c req-51fe8651-7632-44d8-860f-75f3b8b9c056 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.947795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-423aa3eb-e36c-4bf6-aea0-93e6678b3b7c req-51fe8651-7632-44d8-860f-75f3b8b9c056 service nova] Creating event network-vif-plugged:6c158308-7224-4932-8a58-e9d0bdf454eb for instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 on hv-cinder-86021 Oct 04 08:52:26.952669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-423aa3eb-e36c-4bf6-aea0-93e6678b3b7c req-51fe8651-7632-44d8-860f-75f3b8b9c056 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Oct 04 08:52:26.953487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 352/680] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:27.052612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.053163 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.055037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:27.055694 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:27.062678 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.063231 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.063672 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.064395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.064851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.065274 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.095303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f11bf590-5119-468c-bb22-230a18e4d177 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments/f211ab0a-60eb-4f6b-b734-331fd4e8ebd3" status: 200 len: 194 microversion: 2.20 time: 0.046678 Oct 04 08:52:27.095888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 329/681] 10.222.0.26 () {60 vars in 1454 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments/f211ab0a-60eb-4f6b-b734-331fd4e8ebd3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:52:27.161954 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:27.167101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.167841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.174361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.174869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.175309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.176006 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.176469 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.176901 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.257231 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lazy-loading 'services' on Instance uuid d2c490e2-0104-4fcb-b255-1f1c8b41c083 {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:52:27.319495 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:27.331927 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7e41dfaf-b25d-4639-bd04-cdb214e59c24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments/f211ab0a-60eb-4f6b-b734-331fd4e8ebd3" status: 202 len: 0 microversion: 2.20 time: 0.170702 Oct 04 08:52:27.332504 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 353/682] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Oct 4 08:52:27 2022] DELETE /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments/f211ab0a-60eb-4f6b-b734-331fd4e8ebd3 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:52:27.341460 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.343664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.349938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.350418 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.350849 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.351539 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.351984 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.352409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.381456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c4943274-f701-4f3a-8259-6186d60cbf6b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044646 Oct 04 08:52:27.382034 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 330/683] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:52:27.421571 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.422247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.428583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.429072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.429511 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.430231 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.430689 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.431119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.560400 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.567900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b38cc117-a5fd-4be0-be3f-db9b4e06bf89 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.151057 Oct 04 08:52:27.568456 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 354/684] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:28.394070 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.396193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.402642 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.402927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.403358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.404037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.404483 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.404899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.436840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5faeabca-0b19-467e-a272-b3f05252ee9f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046662 Oct 04 08:52:28.437432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 331/685] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:52:28.591924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.592564 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.598884 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.599363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.599796 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.600479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.600928 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.601350 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.729453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.737056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d6973dc1-d231-4f62-8b8d-797b84a33da9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1368 microversion: 2.1 time: 0.149022 Oct 04 08:52:28.737624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 355/686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:29.449255 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.451437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.457801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.458277 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.458707 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.459388 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.459839 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.460254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.488802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cc6de600-5470-4c18-baa1-c6000f40a2fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044187 Oct 04 08:52:29.489530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 332/687] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:52:29.759405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.760017 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.766396 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.766873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.767305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.767989 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.768440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.768865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.895594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.903330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4c809426-77d7-4c75-8388-c3b6ee7a9238 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1559 microversion: 2.1 time: 0.147866 Oct 04 08:52:29.903897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 356/688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:29.925567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.926086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.932497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.932970 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.933412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.934184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.934634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.935056 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.017997 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9456fc05-e1e2-46db-bff8-5c3ba1f368ac tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096144 Oct 04 08:52:30.018583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 333/689] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:30.502032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:30.504272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:30.510014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.510434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.510865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.511550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.511995 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.512410 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.541353 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b8a7b934-df7c-4918-a8eb-d1d65827cf14 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043212 Oct 04 08:52:30.541937 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 357/690] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 08:52:30 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:30.606257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:30.606786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:30.612613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.613085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.613512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.614219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.614668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.615086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.641230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:52:30.720504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ba52cc23-4f0d-4b43-9dfe-7d237b5d57fb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 204 len: 0 microversion: 2.20 time: 0.118754 Oct 04 08:52:30.721136 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 334/691] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 08:52:30 2022] DELETE /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:52:30.729622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:30.730264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:30.736205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.736683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.737115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.737982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.738450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.738871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.872121 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:30.880298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:30.881782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:30.882948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d2965774-b6b3-4407-a8cb-347a99b9fe92 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.157466 Oct 04 08:52:30.883718 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 358/692] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:30 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:31.188006 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-927087a6-c36d-413f-901a-7d400ac5ed5c req-d3605da3-9237-4917-9930-ac95888213a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8d2b2f-7930-42d6-b6d3-5f7a282bd723", "tag": "6c158308-7224-4932-8a58-e9d0bdf454eb"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:31.197715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-927087a6-c36d-413f-901a-7d400ac5ed5c req-d3605da3-9237-4917-9930-ac95888213a0 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.198192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-927087a6-c36d-413f-901a-7d400ac5ed5c req-d3605da3-9237-4917-9930-ac95888213a0 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.198618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-927087a6-c36d-413f-901a-7d400ac5ed5c req-d3605da3-9237-4917-9930-ac95888213a0 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.209656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-927087a6-c36d-413f-901a-7d400ac5ed5c req-d3605da3-9237-4917-9930-ac95888213a0 service nova] Creating event network-changed:6c158308-7224-4932-8a58-e9d0bdf454eb for instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 on hv-cinder-86021 Oct 04 08:52:31.215211 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-927087a6-c36d-413f-901a-7d400ac5ed5c req-d3605da3-9237-4917-9930-ac95888213a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031118 Oct 04 08:52:31.215919 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 335/693] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:31.908529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:31.909145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:31.911632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:31.917568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.918069 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.918385 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.919098 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.919560 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.919989 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.053641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.062352 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.063806 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.064997 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b3836eec-acf0-4c4e-b652-523d8c57b685 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.160465 Oct 04 08:52:32.065760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 359/694] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:31 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:33.092336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:33.093037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:33.099765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.100281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.100716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.101410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.101894 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.102319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.233986 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.242039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.243543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.244708 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8ec8c117-8c43-49b4-9cee-c362c4e17642 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1722 microversion: 2.20 time: 0.156669 Oct 04 08:52:33.245272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 336/695] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:33 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:34.100195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-a7ea8b8f-6f1f-4abe-8455-0e7d1a3cdbda req-20b68c6d-b09e-45e2-8ece-0a1e17ee5f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c490e2-0104-4fcb-b255-1f1c8b41c083", "name": "network-vif-deleted", "tag": "3cedc437-d079-40c2-a255-95cbfb8ae43c"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:34.112144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-a7ea8b8f-6f1f-4abe-8455-0e7d1a3cdbda req-20b68c6d-b09e-45e2-8ece-0a1e17ee5f90 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.112617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-a7ea8b8f-6f1f-4abe-8455-0e7d1a3cdbda req-20b68c6d-b09e-45e2-8ece-0a1e17ee5f90 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.113037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-a7ea8b8f-6f1f-4abe-8455-0e7d1a3cdbda req-20b68c6d-b09e-45e2-8ece-0a1e17ee5f90 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.125391 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-a7ea8b8f-6f1f-4abe-8455-0e7d1a3cdbda req-20b68c6d-b09e-45e2-8ece-0a1e17ee5f90 service nova] Creating event network-vif-deleted:3cedc437-d079-40c2-a255-95cbfb8ae43c for instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 on hv-cinder-86021 Oct 04 08:52:34.130867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-a7ea8b8f-6f1f-4abe-8455-0e7d1a3cdbda req-20b68c6d-b09e-45e2-8ece-0a1e17ee5f90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034187 Oct 04 08:52:34.131747 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 360/696] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:34.271213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:34.271678 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:34.279600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.280105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.280543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.281238 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.281713 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.282132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.316744 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.317225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.317647 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.318117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lazy-loading 'fault' on Instance uuid d2c490e2-0104-4fcb-b255-1f1c8b41c083 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:52:34.368457 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:34.377488 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:34.379289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:34.380441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5b6f1d92-082c-4342-87d8-cdedf47a8602 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 200 len: 1372 microversion: 2.20 time: 0.114753 Oct 04 08:52:34.381188 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 337/697] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:34 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:35.406570 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:35.407265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:35.413846 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.414324 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.415262 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.415945 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.416393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.416813 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.429753 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] HTTP exception thrown: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Request method failure captured: Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 HTTP/1.1 Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_K_pYhnbNSm1_EZGlfK5nGFQxWXNHby0LO4IclAtjWC4NM57WRHBr_0rU4dgFEQlxPD7GhSbhMMP2XHFLqsxH0aBeXsbKehdmD8yqy1e62KJ1q0omr6wj7cptaUz1VAHinZqIprco-rTrJsNblGle9559qEz4r3axreKaINTPU1rXE Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:52:35.432003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}] Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: ed4b7bfb87b144b38b82514c17a468bc Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:52:35.433784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'd2c490e2-0104-4fcb-b255-1f1c8b41c083'} Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:52:35.434791 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:52:35.436372 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:52:35.437754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Returning 404 to user: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:52:35.437754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-bf71a379-5fc6-4fe3-a92a-265d9df8f87a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 404 len: 111 microversion: 2.20 time: 0.031023 Oct 04 08:52:35.437754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 361/698] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:35 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:52:35.442092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-44eeba33-ffd1-4566-b3be-fafad5ba87eb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '.version_select at 0x7f5fd4296940>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:35.460210 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-44eeba33-ffd1-4566-b3be-fafad5ba87eb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130639977" status: 204 len: 0 microversion: 2.20 time: 0.021891 Oct 04 08:52:35.460745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 338/699] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 4 08:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130639977 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 08:52:36.087527 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0365644a-394a-4841-9f7c-69bc80828cb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'create', calling method: .version_select at 0x7f5fd41c10d0>, body: {"keypair": {"name": "tempest-keypair-1649006294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER/9gqr+g883TLIONVLxKeLhRJ+t2G4bn1GioNANe/eXVjC8Ts2PCSXX4GVflmXf0wjqtfrzp2rEpVcY846RxrIJ10mQMuAzw6M+g8RFo1BN5lek8wUDThbmZvbq5jFdQ=="}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:36.103244 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-0365644a-394a-4841-9f7c-69bc80828cb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for project ed8dda1234f54905962e427bf75e82c1. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:36.106963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-0365644a-394a-4841-9f7c-69bc80828cb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for user ed4b7bfb87b144b38b82514c17a468bc and project ed8dda1234f54905962e427bf75e82c1. Resources: {'key_pairs'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:36.128175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0365644a-394a-4841-9f7c-69bc80828cb8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044861 Oct 04 08:52:36.128768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 362/700] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 4 08:52:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 08:52:37.352594 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-795938338", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88c58347-047b-4a5d-8961-d535f7933f4d"}], "security_groups": [{"name": "tempest-securitygroup--1914503258"}], "key_name": "tempest-keypair-1649006294", "user_data": "}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:37.452905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] validate_networks() for [('88c58347-047b-4a5d-8961-d535f7933f4d', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:52:37.813517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:52:37.813987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:52:37.814471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:52:37.814885 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:52:37.815328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:52:37.824512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.824995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.825434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.826200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.826653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.827076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.844784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for project ed8dda1234f54905962e427bf75e82c1. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:37.848887 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Getting quotas for user ed4b7bfb87b144b38b82514c17a468bc and project ed8dda1234f54905962e427bf75e82c1. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:37.859801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:52:37.862098 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:52:37.908245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-29229975-8440-4758-bab3-5a28db6b60c1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.560548 Oct 04 08:52:37.909080 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 339/701] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 4 08:52:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 08:52:37.920725 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1f94bd6f-7efd-4d31-8df6-52d70bd71a21 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:37.921331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1f94bd6f-7efd-4d31-8df6-52d70bd71a21 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:37.981032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1f94bd6f-7efd-4d31-8df6-52d70bd71a21 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.988414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1f94bd6f-7efd-4d31-8df6-52d70bd71a21 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.989886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1f94bd6f-7efd-4d31-8df6-52d70bd71a21 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.990998 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1f94bd6f-7efd-4d31-8df6-52d70bd71a21 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1281 microversion: 2.20 time: 0.074797 Oct 04 08:52:37.991554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 363/702] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:37 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:39.019383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:39.019996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:39.026524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.027006 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.027437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.028117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.028565 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.029013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.088788 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.096691 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.098183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.099275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-88ecd8e8-f6d3-4630-98f7-016b27fe62ec tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1333 microversion: 2.20 time: 0.084284 Oct 04 08:52:39.099823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 340/703] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:39 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:40.124676 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:40.125664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:40.132753 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.133768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.134260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.135304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.135429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.135756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.385632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.393704 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.395202 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.396318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e56147c1-cf3b-4c2e-a76e-9e2cfa9e4526 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.275712 Oct 04 08:52:40.396878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 364/704] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:40 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:40.804135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-c84a9c0d-a6f0-4d98-88b5-82186e4fc3d7 req-f41f3339-d82b-4e40-a2c9-529f14715014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4079470a-d577-4b42-810b-e864cdd7754a", "tag": "a483e39a-a337-488b-8e99-afe48bd9970b"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:40.814227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c84a9c0d-a6f0-4d98-88b5-82186e4fc3d7 req-f41f3339-d82b-4e40-a2c9-529f14715014 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.814827 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c84a9c0d-a6f0-4d98-88b5-82186e4fc3d7 req-f41f3339-d82b-4e40-a2c9-529f14715014 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.815335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c84a9c0d-a6f0-4d98-88b5-82186e4fc3d7 req-f41f3339-d82b-4e40-a2c9-529f14715014 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.827539 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-c84a9c0d-a6f0-4d98-88b5-82186e4fc3d7 req-f41f3339-d82b-4e40-a2c9-529f14715014 service nova] Creating event network-changed:a483e39a-a337-488b-8e99-afe48bd9970b for instance 4079470a-d577-4b42-810b-e864cdd7754a on hv-cinder-86021 Oct 04 08:52:40.832560 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-c84a9c0d-a6f0-4d98-88b5-82186e4fc3d7 req-f41f3339-d82b-4e40-a2c9-529f14715014 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032247 Oct 04 08:52:40.833144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 341/705] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:41.421652 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:41.422281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:41.428655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.429131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.429561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.430977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.431421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.431837 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.556241 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.564132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.565565 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.566709 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-00da6510-a703-455f-9ca5-56c577d70d79 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.148946 Oct 04 08:52:41.567261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 365/706] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:41 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:42.592396 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:42.593094 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:42.599189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.599665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.600099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.600780 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.601228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.601653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.605568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:42.732687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.740672 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.742132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.743769 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0b936b91-bc72-4d38-bc65-2f05147c2db1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.156114 Oct 04 08:52:42.744322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 342/707] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:42 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:43.768815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:43.769428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:43.776246 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.776729 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.777164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.777883 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.778336 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.778761 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.906857 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:43.915008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:43.916538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:43.917660 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-78bd1613-6668-4fef-bcc0-d3628da5db31 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.152732 Oct 04 08:52:43.918267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 366/708] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:43 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:44.942514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:44.943114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:44.949620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:44.950141 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:44.950580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:44.951279 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:44.951920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:44.952348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.090730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.099911 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.101397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.103102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-119d1513-2f87-47fd-a3e6-f5c8edec1fcb tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.164477 Oct 04 08:52:45.103912 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 343/709] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:44 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:46.128133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:46.128749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:46.135782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.136264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.136702 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.137391 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.137871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.138296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.264685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.272829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.274809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.275929 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-838f5877-3a72-4880-b37d-7c57ef671377 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.151717 Oct 04 08:52:46.276484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 367/710] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:46 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:47.067205 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-6f3d29ae-e039-4ac4-b157-48433ec9aa77 req-a73c1f62-5ec2-43a1-9dc9-132e04d70a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4079470a-d577-4b42-810b-e864cdd7754a", "name": "network-vif-plugged", "status": "completed", "tag": "a483e39a-a337-488b-8e99-afe48bd9970b"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:47.078139 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-6f3d29ae-e039-4ac4-b157-48433ec9aa77 req-a73c1f62-5ec2-43a1-9dc9-132e04d70a34 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.078620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-6f3d29ae-e039-4ac4-b157-48433ec9aa77 req-a73c1f62-5ec2-43a1-9dc9-132e04d70a34 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.079071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-6f3d29ae-e039-4ac4-b157-48433ec9aa77 req-a73c1f62-5ec2-43a1-9dc9-132e04d70a34 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.090582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-6f3d29ae-e039-4ac4-b157-48433ec9aa77 req-a73c1f62-5ec2-43a1-9dc9-132e04d70a34 service nova] Creating event network-vif-plugged:a483e39a-a337-488b-8e99-afe48bd9970b for instance 4079470a-d577-4b42-810b-e864cdd7754a on hv-cinder-86021 Oct 04 08:52:47.095355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-6f3d29ae-e039-4ac4-b157-48433ec9aa77 req-a73c1f62-5ec2-43a1-9dc9-132e04d70a34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031886 Oct 04 08:52:47.096007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 344/711] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:47.300644 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:47.301261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:47.307898 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.308384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.308817 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.309512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.309999 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.310442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.451415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.459531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.460930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.462340 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-52ca98a1-9ba8-4bd2-aff6-307b2752e6d4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.165632 Oct 04 08:52:47.462906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 368/712] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:47 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:48.484947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:48.485682 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:48.490420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:48.491107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:48.498577 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.499045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.499471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.500148 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.500590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.501007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.634107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:48.642525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:48.643973 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:48.645080 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-732524ab-dadd-44c3-8ee8-672b4d964af3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1407 microversion: 2.20 time: 0.161277 Oct 04 08:52:48.645641 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 345/713] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:48 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:49.669772 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:49.670380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:49.672316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:49.677866 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.678351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.678785 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.679472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.679925 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.680354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.813390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.821914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.823378 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.824523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a7d3d0f2-b889-4952-b9f7-7d00b6d58847 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1598 microversion: 2.20 time: 0.158687 Oct 04 08:52:49.825070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 369/714] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:49 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:49.849706 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:49.850229 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:49.856523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.856997 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.857429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.858134 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.858583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.859038 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.935679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3969f0f7-9329-4acc-9d8b-5bd2f1477048 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089743 Oct 04 08:52:49.936321 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 346/715] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 4 08:52:49 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:52:51.061065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-237e3ec4-c60e-40cd-ac66-30d5aa70478f req-e8f2f055-2180-4cc4-80a8-d6d625a6e68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4079470a-d577-4b42-810b-e864cdd7754a", "tag": "a483e39a-a337-488b-8e99-afe48bd9970b"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:51.071013 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-237e3ec4-c60e-40cd-ac66-30d5aa70478f req-e8f2f055-2180-4cc4-80a8-d6d625a6e68f service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.071483 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-237e3ec4-c60e-40cd-ac66-30d5aa70478f req-e8f2f055-2180-4cc4-80a8-d6d625a6e68f service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.071907 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-237e3ec4-c60e-40cd-ac66-30d5aa70478f req-e8f2f055-2180-4cc4-80a8-d6d625a6e68f service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.082560 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-237e3ec4-c60e-40cd-ac66-30d5aa70478f req-e8f2f055-2180-4cc4-80a8-d6d625a6e68f service nova] Creating event network-changed:a483e39a-a337-488b-8e99-afe48bd9970b for instance 4079470a-d577-4b42-810b-e864cdd7754a on hv-cinder-86021 Oct 04 08:52:51.088355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-237e3ec4-c60e-40cd-ac66-30d5aa70478f req-e8f2f055-2180-4cc4-80a8-d6d625a6e68f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030950 Oct 04 08:52:51.089105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 370/716] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:05.082927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:05.083669 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=22 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:05.088781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1559726120"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:05.089289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:05.096407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:05.097002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:05.097438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.098153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:05.098599 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:05.099015 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.224426 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.network.security_group_api [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Removing security group 437e075f-e7ee-443c-89af-7e0dace25892 from port 1d1a1b46-d12b-479d-9c8f-be2338ac1d4e Oct 04 08:53:05.559800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6cd39257-e524-4d25-86f5-11152dde26b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/action" status: 202 len: 0 microversion: 2.1 time: 0.478083 Oct 04 08:53:05.560407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 347/717] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:53:05 2022] POST /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:53:05.566587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:05.568555 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=78 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:05.574022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-6260d6cc-caff-4c2b-ba08-aec0ad565f4a req-11d141c1-c949-48bc-98b4-a3f85fad657c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:05.588192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-6260d6cc-caff-4c2b-ba08-aec0ad565f4a req-11d141c1-c949-48bc-98b4-a3f85fad657c service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:05.588897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-6260d6cc-caff-4c2b-ba08-aec0ad565f4a req-11d141c1-c949-48bc-98b4-a3f85fad657c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:05.589392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-6260d6cc-caff-4c2b-ba08-aec0ad565f4a req-11d141c1-c949-48bc-98b4-a3f85fad657c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.620679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-6260d6cc-caff-4c2b-ba08-aec0ad565f4a req-11d141c1-c949-48bc-98b4-a3f85fad657c service nova] Creating event network-changed:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:53:05.627947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-6260d6cc-caff-4c2b-ba08-aec0ad565f4a req-11d141c1-c949-48bc-98b4-a3f85fad657c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062702 Oct 04 08:53:05.628836 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 371/718] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:07.014923 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:07.015466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:07.021418 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.021930 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.022369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.023116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.024091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.024513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.105142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lazy-loading 'services' on Instance uuid aaf125e9-28d5-4c49-979d-0b91a775a707 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:07.221852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2970f183-b4ed-44d4-8f6a-873732369c11 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments/b5c2c77d-15b3-4c3e-af39-6104795aacb8" status: 202 len: 0 microversion: 2.1 time: 0.211169 Oct 04 08:53:07.223429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 348/719] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 08:53:07 2022] DELETE /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments/b5c2c77d-15b3-4c3e-af39-6104795aacb8 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:53:07.232563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:07.235481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:07.242395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.242887 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.243322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.244023 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.244470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.245139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.283026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a661f33a-d4ec-4bc8-a9f2-995b1f7b25ec tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055566 Oct 04 08:53:07.283635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 372/720] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:07 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:07.643514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-b0f69269-b4f3-4b7f-8fa9-179bc95127d4 req-18ae1097-2b0c-4f42-9f9a-a3f14a04e80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:07.654051 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b0f69269-b4f3-4b7f-8fa9-179bc95127d4 req-18ae1097-2b0c-4f42-9f9a-a3f14a04e80f service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.654683 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b0f69269-b4f3-4b7f-8fa9-179bc95127d4 req-18ae1097-2b0c-4f42-9f9a-a3f14a04e80f service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.655118 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b0f69269-b4f3-4b7f-8fa9-179bc95127d4 req-18ae1097-2b0c-4f42-9f9a-a3f14a04e80f service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.667807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-b0f69269-b4f3-4b7f-8fa9-179bc95127d4 req-18ae1097-2b0c-4f42-9f9a-a3f14a04e80f service nova] Creating event network-changed:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:53:07.673481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-b0f69269-b4f3-4b7f-8fa9-179bc95127d4 req-18ae1097-2b0c-4f42-9f9a-a3f14a04e80f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034445 Oct 04 08:53:07.674721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 349/721] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:08.295437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:08.297664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:08.303718 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.304734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.305160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.305960 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.306408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.306825 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.339181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e636f904-0f28-4d28-bc24-21bf10e90cb5 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047595 Oct 04 08:53:08.339958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 373/722] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:08 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:08.849397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:08.850007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:08.856750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.857228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.857661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.858374 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.858826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.859272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.940148 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lazy-loading 'services' on Instance uuid 0b2c9f68-135f-4233-ab6b-497b6be10b2d {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:09.010210 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2de353a2-258e-4e62-8721-fb1280eddb05 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments/71da5d61-c693-4867-8f1c-8be30289906d" status: 202 len: 0 microversion: 2.1 time: 0.165560 Oct 04 08:53:09.010849 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 350/723] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 08:53:08 2022] DELETE /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments/71da5d61-c693-4867-8f1c-8be30289906d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:53:09.019124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:09.021278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:09.027259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.027769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.028205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.028901 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.029363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.029822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.059842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1ad87bad-f046-49f9-8138-c561f02deb43 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Oct 04 08:53:09.060416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 374/724] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:09 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:09.352666 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:09.354989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:09.361975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.362458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.362893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.363579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.364029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.364453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.392799 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1d222f77-d460-440a-b7b0-dec51d7e56f9 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044619 Oct 04 08:53:09.393340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 351/725] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:09 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:53:09.404452 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:09.404956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:09.411332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.411814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.412249 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.412937 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.413391 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.413845 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.487281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] HTTP exception thrown: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 is not attached to volume b5c2c77d-15b3-4c3e-af39-6104795aacb8 Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Request method failure captured: Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments/b5c2c77d-15b3-4c3e-af39-6104795aacb8 HTTP/1.1 Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_M-l8rQPMVgSKuHIFBwrY7Wq1UJEo8V287hUJQKVV62KIrfcFnpDWkyszAPE57aE8oMDcUL5Se7IiH_fGs-F7bs8JefZnjvh7OAosGv8b1ICq2Z28xm6b87nhqab2ePDoy_MEQk24bi5hnStXZDA0NMyiX8Q7_Sq2GrAOMGsgaSocY Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: fe42bae7e14246d78103a4ef69457051 Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-TestMinimumBasicScenario-246626063 Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:53:09.498297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fe42bae7e14246d78103a4ef69457051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fe42bae7e14246d78103a4ef69457051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe42bae7e14246d78103a4ef69457051"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe42bae7e14246d78103a4ef69457051"}]}] Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-TestMinimumBasicScenario-246626063 Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: fe42bae7e14246d78103a4ef69457051 Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-TestMinimumBasicScenario-246626063 Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-TestMinimumBasicScenario-246626063-project Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 8fcf4142aa8340d692b1b3ed0aee7c87 Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-TestMinimumBasicScenario-246626063-project Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:53:09.499780 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 is not attached to volume b5c2c77d-15b3-4c3e-af39-6104795aacb8 Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'server_id': 'aaf125e9-28d5-4c49-979d-0b91a775a707', 'id': 'b5c2c77d-15b3-4c3e-af39-6104795aacb8'} Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b5c2c77d-15b3-4c3e-af39-6104795aacb8. Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:09.500550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 is not attached to volume b5c2c77d-15b3-4c3e-af39-6104795aacb8 Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 is not attached to volume b5c2c77d-15b3-4c3e-af39-6104795aacb8 Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:09.502210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Returning 404 to user: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 is not attached to volume b5c2c77d-15b3-4c3e-af39-6104795aacb8 {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:09.503332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c0b7fa4e-09e2-4d0e-81e3-0b68bb0954b6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments/b5c2c77d-15b3-4c3e-af39-6104795aacb8" status: 404 len: 154 microversion: 2.1 time: 0.099334 Oct 04 08:53:09.503332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 375/726] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 08:53:09 2022] DELETE /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707/os-volume_attachments/b5c2c77d-15b3-4c3e-af39-6104795aacb8 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:10.073154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:10.075316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:10.082497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.083281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.083721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.084406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.084851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.086185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.119171 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-790bccff-27b9-420d-b939-508010bcdb93 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050563 Oct 04 08:53:10.119729 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 352/727] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:10 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:10.637296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:10.637810 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:10.644170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.644656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.645093 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.645814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.646267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.646691 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.672190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:10.744187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9937af9d-f34f-4898-a563-2f3fd6f0e90b tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 204 len: 0 microversion: 2.1 time: 0.110454 Oct 04 08:53:10.744767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 376/728] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:10 2022] DELETE /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:10.754577 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:10.755179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:10.761800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.762282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.762714 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.763405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.763856 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.764280 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.897059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:10.905291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cc3630d1-0760-4839-baab-e75233c705f2 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.155356 Oct 04 08:53:10.905897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 353/729] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:10 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:11.132870 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.135204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.141047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.141526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.141994 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.142706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.143154 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.143599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.172943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-25caefe4-4c66-46d6-8a22-71983da24572 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044379 Oct 04 08:53:11.173411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 377/730] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:11 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:53:11.254414 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.254998 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.261937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.262428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.262855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.263546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.264001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.264427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.289257 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:11.363331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6d6e4b77-65b0-40b0-bdb1-4276d33196ef tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 204 len: 0 microversion: 2.1 time: 0.112581 Oct 04 08:53:11.363903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 354/731] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:11 2022] DELETE /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:11.372505 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.373119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.379030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.379513 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.379957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.380642 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.381095 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.381515 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.507590 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:11.515137 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e54b42c5-cdb8-411b-a7ab-521bcb3b9e56 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1689 microversion: 2.1 time: 0.146449 Oct 04 08:53:11.515699 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 378/732] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:11 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:11.548903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.549485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.555258 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.555734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.556161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.556834 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.557275 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.557703 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.582294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:11.660530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7d30a669-2c69-4482-b1b4-0abe5e84c021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 204 len: 0 microversion: 2.1 time: 0.115382 Oct 04 08:53:11.661121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 355/733] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:11 2022] DELETE /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:11.669462 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.670124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.676397 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.676877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.677310 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.678018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.678470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.678892 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.805711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:11.813354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ca9a2e85-3372-40d7-9892-35b9c5e44c21 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1575 microversion: 2.1 time: 0.147851 Oct 04 08:53:11.813950 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 379/734] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:11 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:11.928937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.929636 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.935397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.935864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.936289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.936962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.937402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.937848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.068199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:12.075821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c33726a2-4928-4d15-a777-0966da071cd4 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.151214 Oct 04 08:53:12.076380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 356/735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:11 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:12.538301 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:12.538832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:12.544859 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.545367 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.545821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.546497 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.546944 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.547371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.676714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:12.684867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f3e0454a-bace-479a-9148-e1274b9765e2 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1689 microversion: 2.1 time: 0.150410 Oct 04 08:53:12.685418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 380/736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:12 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:12.836530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:12.837049 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:12.842829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.843303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.843743 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.844403 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.844850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.845262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.978487 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:12.986086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-19793b79-58f7-479e-95e9-a0eed0b85143 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1575 microversion: 2.1 time: 0.153685 Oct 04 08:53:12.986650 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 357/737] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:12 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:13.099794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:13.100398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:13.107468 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.108533 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.108970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.109662 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.110140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.110566 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.237977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:13.246383 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-10f6e221-2f92-4722-badc-5a60eb9b2dcd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.150576 Oct 04 08:53:13.246960 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 381/738] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:13 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:13.708067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:13.708697 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:13.715585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.716063 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.716490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.717165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.717609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.718048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.845872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:13.853510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3ceca544-9a38-4c46-a6ba-7cf55771132b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1689 microversion: 2.1 time: 0.149236 Oct 04 08:53:13.854107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 358/739] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:13 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:14.010144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:14.010701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:14.017003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.017480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.017942 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.018618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.019063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.019480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.156058 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:14.163761 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-01e1e602-5372-4a33-868d-5decb24486c7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1575 microversion: 2.1 time: 0.158128 Oct 04 08:53:14.164314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 382/740] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:14 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:14.269837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:14.270478 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:14.276823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.277295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.277768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.278519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.278882 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.279301 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.405418 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:14.408898 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:14.414366 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4c6760d2-c246-4088-b127-996c9af2ec92 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.148437 Oct 04 08:53:14.414964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 359/741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:14 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:14.876037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:14.876645 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:14.883172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.883651 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.884083 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.884763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.885211 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.885638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.009041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:15.017204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-149d8a57-8200-4527-99e6-ea4038a5c015 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1689 microversion: 2.1 time: 0.145049 Oct 04 08:53:15.026012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 383/742] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:14 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:15.186733 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:15.187338 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:15.194312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.194790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.195225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.195906 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.196354 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.196776 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.326147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:15.333718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f03c3760-fb47-4ab7-b7b8-efe2c3ff9208 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1575 microversion: 2.1 time: 0.150833 Oct 04 08:53:15.334272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 360/743] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:15 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:15.438106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:15.438958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:15.444850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.445328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.445783 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.446463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.446912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.447328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.570995 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:15.578687 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9782dfd4-b496-4f40-813b-8be66328a3b7 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.144436 Oct 04 08:53:15.579252 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 384/744] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:15 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:16.039531 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:16.040147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:16.046052 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.046534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.046969 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.047654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.048105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.048528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.178213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:16.185888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7a21fd33-859f-4dec-a277-653371bc57ec tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1689 microversion: 2.1 time: 0.150378 Oct 04 08:53:16.186451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 361/745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:16 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:16.357363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:16.358022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:16.364347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.364826 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.365285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.365987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.366441 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.366860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.498090 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:16.505648 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4927b000-33f5-404f-8eab-d60de038ca76 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1575 microversion: 2.1 time: 0.152148 Oct 04 08:53:16.506237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 385/746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:16 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:16.602725 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:16.603287 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:16.609553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.610068 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.610506 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.611195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.611651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.612080 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.738278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:16.745933 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7b315e79-51ab-4f6c-9bec-ce845a49881e tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.147647 Oct 04 08:53:16.746497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 362/747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:16 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:17.120607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-f62b2142-b778-4159-92a2-3f9e03a8d371 req-e0610872-fcc2-40ed-8fb1-ccf55aca4aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "name": "network-vif-unplugged", "status": "completed", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:17.131010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-f62b2142-b778-4159-92a2-3f9e03a8d371 req-e0610872-fcc2-40ed-8fb1-ccf55aca4aa3 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:17.131490 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-f62b2142-b778-4159-92a2-3f9e03a8d371 req-e0610872-fcc2-40ed-8fb1-ccf55aca4aa3 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:17.131925 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-f62b2142-b778-4159-92a2-3f9e03a8d371 req-e0610872-fcc2-40ed-8fb1-ccf55aca4aa3 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.142967 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-f62b2142-b778-4159-92a2-3f9e03a8d371 req-e0610872-fcc2-40ed-8fb1-ccf55aca4aa3 service nova] Creating event network-vif-unplugged:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:53:17.148466 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-f62b2142-b778-4159-92a2-3f9e03a8d371 req-e0610872-fcc2-40ed-8fb1-ccf55aca4aa3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031634 Oct 04 08:53:17.149256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 386/748] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:17.208574 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:17.209193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:17.216010 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:17.216501 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:17.216941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.217638 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:17.218120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:17.218547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.347970 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:17.356186 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-675da224-5dcb-4478-a779-b26ce22314cc tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1689 microversion: 2.1 time: 0.151463 Oct 04 08:53:17.356779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 363/749] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:17 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:17.529947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:17.530655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:17.536735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:17.537228 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:17.537669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.538909 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:17.539367 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:17.539797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.543920 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:17.672187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:17.680587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-971d12b4-792b-44c3-b2a7-a83b88eed668 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1575 microversion: 2.1 time: 0.155510 Oct 04 08:53:17.681153 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 387/750] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:17 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:17.768520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:17.769146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:17.775423 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:17.775903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:17.776341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.777028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:17.777489 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:17.777945 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.902306 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:17.910085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-31b6bf82-12a3-4bd6-ae7b-f970ffbf2ebf tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.145487 Oct 04 08:53:17.910648 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 364/751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:17 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:18.380395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:18.381179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:18.387046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.387535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.387973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.388668 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.389127 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.389559 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.704545 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:18.705198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:18.712074 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.712563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.713007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.713735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.714194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.714622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.822075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:18.829902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7747d670-f322-48f3-b0e4-8ac94256946b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1689 microversion: 2.1 time: 0.453371 Oct 04 08:53:18.831314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 388/752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:18 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1689 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:18.845445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:18.855211 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a5b4248c-ecb4-4b27-b976-ffa913ab43b7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1575 microversion: 2.1 time: 0.154581 Oct 04 08:53:18.855784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 365/753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:18 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:18.933866 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:18.934473 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:18.940304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.940784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.941216 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.941921 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.942392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.942808 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.605445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf4142aa8340d692b1b3ed0aee7c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42bae7e14246d78103a4ef69457051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:19.613397 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9def6709-0c57-4f55-aebf-a6ce354244cd tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 200 len: 1554 microversion: 2.1 time: 0.683450 Oct 04 08:53:19.614272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 389/754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:18 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 1554 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:19.634447 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-2b4fa5e3-2faf-4b84-9dda-065847a110b2 req-9d08dcd6-fdb2-46b3-aac6-dc9755cb1cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf125e9-28d5-4c49-979d-0b91a775a707", "name": "network-vif-deleted", "tag": "1d1a1b46-d12b-479d-9c8f-be2338ac1d4e"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:19.644040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-2b4fa5e3-2faf-4b84-9dda-065847a110b2 req-9d08dcd6-fdb2-46b3-aac6-dc9755cb1cd7 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.644514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-2b4fa5e3-2faf-4b84-9dda-065847a110b2 req-9d08dcd6-fdb2-46b3-aac6-dc9755cb1cd7 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.644938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-2b4fa5e3-2faf-4b84-9dda-065847a110b2 req-9d08dcd6-fdb2-46b3-aac6-dc9755cb1cd7 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.661476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-2b4fa5e3-2faf-4b84-9dda-065847a110b2 req-9d08dcd6-fdb2-46b3-aac6-dc9755cb1cd7 service nova] Creating event network-vif-deleted:1d1a1b46-d12b-479d-9c8f-be2338ac1d4e for instance aaf125e9-28d5-4c49-979d-0b91a775a707 on hv-cinder-86021 Oct 04 08:53:19.663403 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-2b4fa5e3-2faf-4b84-9dda-065847a110b2 req-9d08dcd6-fdb2-46b3-aac6-dc9755cb1cd7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032005 Oct 04 08:53:19.664292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 366/755] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:19.857157 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:19.858482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:19.870384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.871334 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.872854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.880479 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:19.882636 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:19.886457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.887269 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.889856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.895821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.898162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.898750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.899588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.902246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.905363 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.017919 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:20.038413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c8ba7dd6-1ea4-48bc-bc72-d6c15addc3f8 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1507 microversion: 2.1 time: 0.162886 Oct 04 08:53:20.039030 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 367/756] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:19 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:20.063861 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:20.072406 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-863a2b9a-1ce2-4072-830b-231c4a6bc53e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1621 microversion: 2.1 time: 0.220917 Oct 04 08:53:20.073008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 390/757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:19 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1621 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:20.636702 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.637325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] [instance: aaf125e9-28d5-4c49-979d-0b91a775a707] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:20.649389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.649961 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.651678 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.652899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.653389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.653849 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.680460 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] HTTP exception thrown: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 could not be found. Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Request method failure captured: Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 HTTP/1.1 Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_M-l8rQPMVgSKuHIFBwrY7Wq1UJEo8V287hUJQKVV62KIrfcFnpDWkyszAPE57aE8oMDcUL5Se7IiH_fGs-F7bs8JefZnjvh7OAosGv8b1ICq2Z28xm6b87nhqab2ePDoy_MEQk24bi5hnStXZDA0NMyiX8Q7_Sq2GrAOMGsgaSocY Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: fe42bae7e14246d78103a4ef69457051 Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-TestMinimumBasicScenario-246626063 Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:53:20.682737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fe42bae7e14246d78103a4ef69457051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fe42bae7e14246d78103a4ef69457051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe42bae7e14246d78103a4ef69457051"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe42bae7e14246d78103a4ef69457051"}]}] Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-TestMinimumBasicScenario-246626063 Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: fe42bae7e14246d78103a4ef69457051 Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-TestMinimumBasicScenario-246626063 Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-TestMinimumBasicScenario-246626063-project Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 8fcf4142aa8340d692b1b3ed0aee7c87 Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-TestMinimumBasicScenario-246626063-project Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 could not be found. Oct 04 08:53:20.684376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'aaf125e9-28d5-4c49-979d-0b91a775a707'} Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 could not be found. Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:20.685294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 could not be found. Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 could not be found. Oct 04 08:53:20.686802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.689002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Returning 404 to user: Instance aaf125e9-28d5-4c49-979d-0b91a775a707 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:20.690040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f181e15e-1e57-446b-9799-74f141fe6fea tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707" status: 404 len: 111 microversion: 2.1 time: 0.057101 Oct 04 08:53:20.690745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 368/758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:20 2022] GET /compute/v2.1/servers/aaf125e9-28d5-4c49-979d-0b91a775a707 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:20.700067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-97b1e6e7-8fc2-4e02-ac3d-dcdf61f33fe6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] Calling method '.version_select at 0x7f5fd4230820>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.725912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-97b1e6e7-8fc2-4e02-ac3d-dcdf61f33fe6 tempest-TestMinimumBasicScenario-246626063 tempest-TestMinimumBasicScenario-246626063-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-645764209" status: 202 len: 0 microversion: 2.1 time: 0.030168 Oct 04 08:53:20.731722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 391/759] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 4 08:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-645764209 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:53:21.062537 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:21.063848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:21.072363 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.073469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.074493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.076114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.076779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.077418 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.096079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:21.097463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:21.117932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.118458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.119085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.119383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.119789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.119915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lazy-loading 'fault' on Instance uuid b291a8e2-ddea-408e-b850-2a968115efcf {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:21.120565 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.122144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.123631 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.124602 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.168831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:21.177182 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-70225925-aa22-47ae-a237-ecd6c06d4a7c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 200 len: 1228 microversion: 2.1 time: 0.118527 Oct 04 08:53:21.178607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 369/760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:21 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 1228 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:21.200461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.201073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.201505 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.202284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lazy-loading 'fault' on Instance uuid 0b2c9f68-135f-4233-ab6b-497b6be10b2d {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:21.257860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:21.284031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9c89f427-0f2d-4b4a-bd16-2666164e9eaf tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 200 len: 1334 microversion: 2.1 time: 0.191248 Oct 04 08:53:21.285484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 392/761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:21 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 1334 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:21.683831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-59bd20ae-32f1-4caa-85d9-82de10362026 req-fdc3bbda-c218-4bc0-95ce-5a950f6e639d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2c9f68-135f-4233-ab6b-497b6be10b2d", "name": "network-vif-deleted", "tag": "a438852b-8790-40e5-aff4-07d0c3a3ad41"}, {"server_uuid": "b291a8e2-ddea-408e-b850-2a968115efcf", "name": "network-vif-deleted", "tag": "f3a2f548-e482-4524-83a5-a96b3b292574"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:21.694806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-59bd20ae-32f1-4caa-85d9-82de10362026 req-fdc3bbda-c218-4bc0-95ce-5a950f6e639d service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.695281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-59bd20ae-32f1-4caa-85d9-82de10362026 req-fdc3bbda-c218-4bc0-95ce-5a950f6e639d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.695700 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-59bd20ae-32f1-4caa-85d9-82de10362026 req-fdc3bbda-c218-4bc0-95ce-5a950f6e639d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.712397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-59bd20ae-32f1-4caa-85d9-82de10362026 req-fdc3bbda-c218-4bc0-95ce-5a950f6e639d service nova] Creating event network-vif-deleted:a438852b-8790-40e5-aff4-07d0c3a3ad41 for instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d on hv-cinder-86021 Oct 04 08:53:21.713148 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-59bd20ae-32f1-4caa-85d9-82de10362026 req-fdc3bbda-c218-4bc0-95ce-5a950f6e639d service nova] Creating event network-vif-deleted:f3a2f548-e482-4524-83a5-a96b3b292574 for instance b291a8e2-ddea-408e-b850-2a968115efcf on hv-cinder-86021 Oct 04 08:53:21.720169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-59bd20ae-32f1-4caa-85d9-82de10362026 req-fdc3bbda-c218-4bc0-95ce-5a950f6e639d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040020 Oct 04 08:53:21.721131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 370/762] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:22.200968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:22.201613 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:22.207936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.208419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.208847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.210174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.211117 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.211395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.224702 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] HTTP exception thrown: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Request method failure captured: Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf HTTP/1.1 Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_OBUVlVtAzk4bHyWws0RHFgJzBXwBIAbJ8cWlSB8tOnyHqoA5hPysXIolJDBR45MRVpMhnqS-GL7iHSOh_uVzrQpxognyxodU1tq6-pFibGEmEJo4ogNLLpG92cycQt5gXA8yySuE-XLWwBgX0QHwcVqWDVaTHDDmPTv-edmmA8-c8 Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:53:22.226832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}] Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-TestVolumeBootPattern-716806877 Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: f928852d90b94ac5979e4a7806896b7a Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:53:22.228369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'b291a8e2-ddea-408e-b850-2a968115efcf'} Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:22.229149 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:53:22.230415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.231620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Returning 404 to user: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:22.231620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b2a63aed-9f60-4281-89dd-fb8ca5ae7021 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 404 len: 111 microversion: 2.1 time: 0.030784 Oct 04 08:53:22.233348 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 393/763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:22 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:22.313303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:22.314040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: 0b2c9f68-135f-4233-ab6b-497b6be10b2d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:22.320577 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.321236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.321915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.322626 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.323084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.323512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.326066 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-933837560", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-322513154", "security_groups": [{"name": "tempest-secgroup-smoke-1244527694"}], "block_device_mapping_v2": [{"uuid": "4cc4a930-a596-4f7d-af8b-55a76d786c0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c006435c-ff61-43c2-8f47-dde46c8ddc02"}]}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:22.338177 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] HTTP exception thrown: Instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d could not be found. Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Request method failure captured: Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d HTTP/1.1 Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LFl7xKXNfF9BfAgAnIN4w4ISqldMi8hBBZcCI7rcHZibCN8zsPrTIGBG6JnFl3MtYZHlNjdg42i7uQb2P5Ypp6OhGpYoVd4S0aChqIAhnHQ8t59fylgmlx_HVA1GNV9w92vrqm4HmQGY0tm-Vt1sHFUvt-kg6M82-7GNA-5KG5mxI Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:53:22.339974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b7703aae5634dabb496bc221882863c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b7703aae5634dabb496bc221882863c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}] Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: acf57eb971eb4f78b173a5ab47160bd1 Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d could not be found. Oct 04 08:53:22.341331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '0b2c9f68-135f-4233-ab6b-497b6be10b2d'} Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d could not be found. Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:22.342119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d could not be found. Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d could not be found. Oct 04 08:53:22.343316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:22.344428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Returning 404 to user: Instance 0b2c9f68-135f-4233-ab6b-497b6be10b2d could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:22.344428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0137024b-7726-45c0-a891-bb1efe39f940 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d" status: 404 len: 111 microversion: 2.1 time: 0.032966 Oct 04 08:53:22.344428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 371/764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:22 2022] GET /compute/v2.1/servers/0b2c9f68-135f-4233-ab6b-497b6be10b2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:22.350690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-60cb2e51-aa66-4d40-b498-b099a519c29c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '.version_select at 0x7f5fd7b59af0>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:22.370475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-60cb2e51-aa66-4d40-b498-b099a519c29c tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124092331" status: 202 len: 0 microversion: 2.1 time: 0.024042 Oct 04 08:53:22.371304 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 372/765] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 4 08:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124092331 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:53:22.480957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] validate_networks() for [('c006435c-ff61-43c2-8f47-dde46c8ddc02', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:53:23.206492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:53:23.208189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:53:23.210061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:53:23.211007 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:53:23.212172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:53:23.226720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:23.229567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:23.230272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:23.231250 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:23.231981 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:23.232650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:23.260885 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:53:23.267562 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for user f928852d90b94ac5979e4a7806896b7a and project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:53:23.346052 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:53:23.351158 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cc4a930-a596-4f7d-af8b-55a76d786c0c',volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:53:23.544857 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6881a7ca-104a-47af-80ba-47a678d53b9c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.222650 Oct 04 08:53:23.545893 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 394/766] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:53:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:53:23.557648 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-dd5d970c-4091-4c94-9774-d02ddfa60b68 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:23.558865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-dd5d970c-4091-4c94-9774-d02ddfa60b68 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:23.885059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-dd5d970c-4091-4c94-9774-d02ddfa60b68 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:23.894199 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-dd5d970c-4091-4c94-9774-d02ddfa60b68 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1093 microversion: 2.1 time: 0.341268 Oct 04 08:53:23.895194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 373/767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:23 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1093 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:24.920384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:24.924720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:24.932745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.933501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.934362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:24.935215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.935963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.936588 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.074043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:25.082105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4a5a6a78-a77c-4c37-8b60-8cd26cb1a5a3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1209 microversion: 2.1 time: 0.167721 Oct 04 08:53:25.082686 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 395/768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:24 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1209 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:25.766823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:25.768346 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:25.779239 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.780013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.780684 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.781786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.782410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.783165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.811044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:25.909438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8e6d34f8-38a9-4fb6-b655-d49c45428828 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 204 len: 0 microversion: 2.1 time: 0.148271 Oct 04 08:53:25.911541 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 374/769] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:25 2022] DELETE /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:25.919734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:25.920356 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:25.927467 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.928679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.929324 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.930347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.931030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.931450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.106983 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:26.108169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:26.114334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.115177 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.116371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.117339 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.118044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.118691 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.300608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:26.321818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f09d6916-9c24-44e9-ad1c-ef193d6efd20 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1506 microversion: 2.1 time: 0.402815 Oct 04 08:53:26.323188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 396/770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:25 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:26.392455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:26.406014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-eeee67f9-9309-416d-b3e6-74e22c9e98dc tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.303139 Oct 04 08:53:26.408085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 375/771] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:26 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:27.225598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-01f6830f-3a28-4bd1-832e-244814f348b6 req-b60051e2-89a2-4320-ad1f-baa803dad3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d445b13f-7aa8-4ad3-8013-9f960b391f87", "tag": "5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:27.244628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-01f6830f-3a28-4bd1-832e-244814f348b6 req-b60051e2-89a2-4320-ad1f-baa803dad3e9 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.246139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-01f6830f-3a28-4bd1-832e-244814f348b6 req-b60051e2-89a2-4320-ad1f-baa803dad3e9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.247025 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-01f6830f-3a28-4bd1-832e-244814f348b6 req-b60051e2-89a2-4320-ad1f-baa803dad3e9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.270626 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-01f6830f-3a28-4bd1-832e-244814f348b6 req-b60051e2-89a2-4320-ad1f-baa803dad3e9 service nova] Creating event network-changed:5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee for instance d445b13f-7aa8-4ad3-8013-9f960b391f87 on hv-cinder-86021 Oct 04 08:53:27.281733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-01f6830f-3a28-4bd1-832e-244814f348b6 req-b60051e2-89a2-4320-ad1f-baa803dad3e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061099 Oct 04 08:53:27.286366 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 397/772] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:27.350504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:27.352441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:27.359515 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.360289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.361115 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.362062 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.362845 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.363478 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.435262 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:27.436337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:27.442823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.443569 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.444206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.444914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.445369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.445935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.578688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:27.590176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e98d17dd-632b-434e-b5d8-494dd518fa3e tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1506 microversion: 2.1 time: 0.243974 Oct 04 08:53:27.590755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 376/773] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:27 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:27.792182 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:27.803985 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0065edb2-2998-4b21-b8d8-6d82acbe9495 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.374227 Oct 04 08:53:27.804872 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 398/774] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:27 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:28.613757 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:28.614748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:28.622410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.622906 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.623343 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.624046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.624532 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.625111 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.657490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.658037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.658475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.658933 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lazy-loading 'fault' on Instance uuid ba00a4bd-7048-40e3-8959-08035cc5d3f4 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:28.792373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:28.799934 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a2961965-091d-4ca9-9f33-b495be000e12 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 200 len: 1311 microversion: 2.1 time: 0.190417 Oct 04 08:53:28.800497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 377/775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:28 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:28.826022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:28.826636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:28.832855 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.833334 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.833799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.834488 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.834936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.835619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.980797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:28.991097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2682b179-564e-434c-af11-2abc54e08a24 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.168273 Oct 04 08:53:28.992295 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 399/776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:28 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:29.304132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-d32467e5-0dea-47f2-a332-a75896aff531 req-f70bc3fd-0930-4b82-9bab-92e5bd6220b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba00a4bd-7048-40e3-8959-08035cc5d3f4", "name": "network-vif-deleted", "tag": "dccd562a-a7a1-4225-9d91-75e4cd339aff"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:29.313398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-d32467e5-0dea-47f2-a332-a75896aff531 req-f70bc3fd-0930-4b82-9bab-92e5bd6220b8 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.313915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-d32467e5-0dea-47f2-a332-a75896aff531 req-f70bc3fd-0930-4b82-9bab-92e5bd6220b8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.314453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-d32467e5-0dea-47f2-a332-a75896aff531 req-f70bc3fd-0930-4b82-9bab-92e5bd6220b8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.325198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-d32467e5-0dea-47f2-a332-a75896aff531 req-f70bc3fd-0930-4b82-9bab-92e5bd6220b8 service nova] Creating event network-vif-deleted:dccd562a-a7a1-4225-9d91-75e4cd339aff for instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 on hv-cinder-86021 Oct 04 08:53:29.330002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-d32467e5-0dea-47f2-a332-a75896aff531 req-f70bc3fd-0930-4b82-9bab-92e5bd6220b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030046 Oct 04 08:53:29.330582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 378/777] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:29.823068 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:29.823697 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ba00a4bd-7048-40e3-8959-08035cc5d3f4] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:29.830534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.831131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.831822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.832507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.833039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.833461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.847763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] HTTP exception thrown: Instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 could not be found. Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Request method failure captured: Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 HTTP/1.1 Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LFl7xKXNfF9BfAgAnIN4w4ISqldMi8hBBZcCI7rcHZibCN8zsPrTIGBG6JnFl3MtYZHlNjdg42i7uQb2P5Ypp6OhGpYoVd4S0aChqIAhnHQ8t59fylgmlx_HVA1GNV9w92vrqm4HmQGY0tm-Vt1sHFUvt-kg6M82-7GNA-5KG5mxI Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:53:29.850629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b7703aae5634dabb496bc221882863c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b7703aae5634dabb496bc221882863c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}] Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: acf57eb971eb4f78b173a5ab47160bd1 Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 could not be found. Oct 04 08:53:29.852028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'ba00a4bd-7048-40e3-8959-08035cc5d3f4'} Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 could not be found. Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:29.852766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 could not be found. Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 could not be found. Oct 04 08:53:29.854037 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:29.855119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Returning 404 to user: Instance ba00a4bd-7048-40e3-8959-08035cc5d3f4 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:29.855119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-213a86ab-cbef-48eb-ba52-8c5ddf34cf82 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4" status: 404 len: 111 microversion: 2.1 time: 0.033231 Oct 04 08:53:29.855119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 400/778] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:29 2022] GET /compute/v2.1/servers/ba00a4bd-7048-40e3-8959-08035cc5d3f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:53:29.861842 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:29.862551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:29.869539 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.870061 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.870502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.871229 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.871687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.872113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.890311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:29.899266 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:29.982377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e80301c9-040b-4888-9435-6b6b1402ca40 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 204 len: 0 microversion: 2.1 time: 0.124451 Oct 04 08:53:29.983244 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 379/779] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:29 2022] DELETE /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:29.993501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:29.994250 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:30.000823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.001312 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.001852 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.002573 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.003021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.003639 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.017212 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:30.018265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:30.024693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:30.027001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.028050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.028649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.029593 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.030218 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.030801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.158813 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:30.168106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-772d1c5f-3c1e-4f90-bbcd-95c5043b1cc7 tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1521 microversion: 2.1 time: 0.180337 Oct 04 08:53:30.168787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 401/780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:29 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:30.195705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:30.203452 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-55b161b4-8489-4abf-bdc7-a7af81470d55 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.191624 Oct 04 08:53:30.204004 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 380/781] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:30 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:31.191833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:31.192462 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:31.199224 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.199698 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.200128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.200800 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.201245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.201664 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.226611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:31.227388 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:31.234755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.235323 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.235831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.236598 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.237124 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.237617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.319649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf57eb971eb4f78b173a5ab47160bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7703aae5634dabb496bc221882863c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:31.329030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d1307ca9-494c-445e-ad62-5fe4df787b0d tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 200 len: 1479 microversion: 2.1 time: 0.141538 Oct 04 08:53:31.329679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 402/782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:31 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 1479 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:31.374988 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-5fa8cfd8-9a5b-41a0-82ba-561a3bd3b01a req-64db3c6c-33a8-4d6d-82a9-129a3067e477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab02709a-3a90-4a5c-a268-deb0ab3e95c8", "name": "network-vif-deleted", "tag": "0ccb9534-559a-4485-9935-ec9f4f50c53e"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:31.382894 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:31.386782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5fa8cfd8-9a5b-41a0-82ba-561a3bd3b01a req-64db3c6c-33a8-4d6d-82a9-129a3067e477 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.387904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5fa8cfd8-9a5b-41a0-82ba-561a3bd3b01a req-64db3c6c-33a8-4d6d-82a9-129a3067e477 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.388359 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5fa8cfd8-9a5b-41a0-82ba-561a3bd3b01a req-64db3c6c-33a8-4d6d-82a9-129a3067e477 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.391412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-941f39d5-6567-4ba9-b5e7-235128fec3c4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.168605 Oct 04 08:53:31.401606 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-5fa8cfd8-9a5b-41a0-82ba-561a3bd3b01a req-64db3c6c-33a8-4d6d-82a9-129a3067e477 service nova] Creating event network-vif-deleted:0ccb9534-559a-4485-9935-ec9f4f50c53e for instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 on hv-cinder-86021 Oct 04 08:53:31.405960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 381/783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:31 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:31.406795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-5fa8cfd8-9a5b-41a0-82ba-561a3bd3b01a req-64db3c6c-33a8-4d6d-82a9-129a3067e477 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036295 Oct 04 08:53:31.407376 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 403/784] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:32.356116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.356757 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] [instance: ab02709a-3a90-4a5c-a268-deb0ab3e95c8] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.364052 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.364532 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.364984 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.366345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.366797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.367217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.380798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] HTTP exception thrown: Instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 could not be found. Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Request method failure captured: Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 HTTP/1.1 Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LFl7xKXNfF9BfAgAnIN4w4ISqldMi8hBBZcCI7rcHZibCN8zsPrTIGBG6JnFl3MtYZHlNjdg42i7uQb2P5Ypp6OhGpYoVd4S0aChqIAhnHQ8t59fylgmlx_HVA1GNV9w92vrqm4HmQGY0tm-Vt1sHFUvt-kg6M82-7GNA-5KG5mxI Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:53:32.382481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b7703aae5634dabb496bc221882863c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b7703aae5634dabb496bc221882863c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b7703aae5634dabb496bc221882863c"}]}] Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 0b7703aae5634dabb496bc221882863c Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1467200258 Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: acf57eb971eb4f78b173a5ab47160bd1 Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1467200258-project Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 could not be found. Oct 04 08:53:32.384076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'ab02709a-3a90-4a5c-a268-deb0ab3e95c8'} Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 could not be found. Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:32.385007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 could not be found. Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 could not be found. Oct 04 08:53:32.386510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:53:32.388050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] Returning 404 to user: Instance ab02709a-3a90-4a5c-a268-deb0ab3e95c8 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:32.388050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f3057f81-6cf3-4944-a07e-9c1540eee40b tempest-ServerRescueNegativeTestJSON-1467200258 tempest-ServerRescueNegativeTestJSON-1467200258-project] 10.222.0.26 "GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8" status: 404 len: 111 microversion: 2.1 time: 0.031906 Oct 04 08:53:32.388050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 382/785] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:32 2022] GET /compute/v2.1/servers/ab02709a-3a90-4a5c-a268-deb0ab3e95c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:32.416488 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.417316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.423298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.423782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.424215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.424903 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.425357 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.425805 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.560145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:32.568017 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-43a9348d-9309-4ed1-9f90-7acf834ea68b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.156598 Oct 04 08:53:32.568591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 404/786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:32 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:33.590837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:33.591451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:33.598435 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.598952 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.599385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.600087 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.600533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.600951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.747031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:33.755101 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5edd9ce9-49a7-4d4c-aada-433d0a014896 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.168018 Oct 04 08:53:33.755785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 383/787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:33 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:34.775636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:34.777548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:34.782437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:34.783074 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:34.790820 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.791583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.792073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.793103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.793503 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.793923 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.058328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:35.067225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c2dd6e2e-16dd-4646-ace2-0c23d5e0ed5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.292446 Oct 04 08:53:35.067802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 405/788] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:34 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:36.089996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:36.090611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:36.093360 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:36.098028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:36.098507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:36.098936 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:36.100140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:36.100583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:36.100999 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:36.258888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:36.267141 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-196e774a-9d75-4dfc-a92b-468c5f6b1840 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.180754 Oct 04 08:53:36.267649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 384/789] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:36 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:37.090000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ad46bbdd-3440-49e8-923a-9a01ec3bfe3e tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Action: 'create', calling method: .version_select at 0x7f5fd4279940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-343108064", "metadata": {"Type": "work"}}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:37.290846 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:37.291921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:37.306040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.306040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.306536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.308355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.308945 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.309380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.413164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ad46bbdd-3440-49e8-923a-9a01ec3bfe3e tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.434552 Oct 04 08:53:37.414439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 406/790] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 08:53:36 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 08:53:37.429277 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-917e8835-0559-4d6e-abc1-4851aa026316 tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Calling method '.version_select at 0x7f5fd40918b0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:37.477131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:37.484754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bb7a1b0c-bb39-4cc2-936e-f0c220a88731 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.198808 Oct 04 08:53:37.485322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 385/791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:37 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:37.496296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-917e8835-0559-4d6e-abc1-4851aa026316 tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d" status: 200 len: 352 microversion: 2.1 time: 0.073028 Oct 04 08:53:37.496873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 407/792] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:53:37 2022] GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:38.507915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:38.508635 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:38.513485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ea286812-7ffe-4121-8765-5c479c4479ce tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Calling method '.version_select at 0x7f5fd40ea430>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:38.515598 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.516142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.516629 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.517393 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.517927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.518356 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.560164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ea286812-7ffe-4121-8765-5c479c4479ce tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d" status: 200 len: 353 microversion: 2.1 time: 0.053426 Oct 04 08:53:38.560728 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 408/793] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:53:38 2022] GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:38.573142 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3807f807-bd0e-4c02-9602-880524e13ea9 tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Calling method '.version_select at 0x7f5fd40e2d30>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:38.622826 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3807f807-bd0e-4c02-9602-880524e13ea9 tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d" status: 200 len: 353 microversion: 2.1 time: 0.053285 Oct 04 08:53:38.623405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 409/794] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:53:38 2022] GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:38.642822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f16c4124-ad3e-4f65-b97c-b2dcaa17a865 tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Calling method '.version_select at 0x7f5fd41f13a0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:38.659917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:38.668472 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-53856721-3cbc-41a1-a73a-866615004f2e tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.164650 Oct 04 08:53:38.669066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 386/795] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:38 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:38.705278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f16c4124-ad3e-4f65-b97c-b2dcaa17a865 tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d" status: 202 len: 0 microversion: 2.1 time: 0.066743 Oct 04 08:53:38.706071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 410/796] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:53:38 2022] DELETE /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:53:38.714632 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-25ff7253-b682-4d68-b1b1-4a2913f1315e tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Calling method '.version_select at 0x7f5fd7b89040>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:38.763813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-25ff7253-b682-4d68-b1b1-4a2913f1315e tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d" status: 200 len: 352 microversion: 2.1 time: 0.053095 Oct 04 08:53:38.764405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 387/797] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:53:38 2022] GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:39.256123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-357c6c03-6572-4235-af39-cbe2c0393fdf req-fdcf039e-f3cf-4c05-a5fa-d02d55b303ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d445b13f-7aa8-4ad3-8013-9f960b391f87", "name": "network-vif-plugged", "status": "completed", "tag": "5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:39.267050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:39.276122 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-357c6c03-6572-4235-af39-cbe2c0393fdf req-fdcf039e-f3cf-4c05-a5fa-d02d55b303ea service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.276542 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-357c6c03-6572-4235-af39-cbe2c0393fdf req-fdcf039e-f3cf-4c05-a5fa-d02d55b303ea service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.276978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-357c6c03-6572-4235-af39-cbe2c0393fdf req-fdcf039e-f3cf-4c05-a5fa-d02d55b303ea service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.288079 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-357c6c03-6572-4235-af39-cbe2c0393fdf req-fdcf039e-f3cf-4c05-a5fa-d02d55b303ea service nova] Creating event network-vif-plugged:5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee for instance d445b13f-7aa8-4ad3-8013-9f960b391f87 on hv-cinder-86021 Oct 04 08:53:39.293307 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-357c6c03-6572-4235-af39-cbe2c0393fdf req-fdcf039e-f3cf-4c05-a5fa-d02d55b303ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048642 Oct 04 08:53:39.294106 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 411/798] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:39.691545 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:39.692160 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:39.698160 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.698645 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.699114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.699822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.700304 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.700753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.779731 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d205caf1-4fc2-4a06-aac4-0af88baa149c tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Calling method '.version_select at 0x7f5fd40d0280>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:39.809059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-d205caf1-4fc2-4a06-aac4-0af88baa149c tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] HTTP exception thrown: Volume 2b319836-b981-4e85-a46a-31b4d968f36d could not be found. Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d205caf1-4fc2-4a06-aac4-0af88baa149c tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Request method failure captured: Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d HTTP/1.1 Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_SQiYd_Agz78Blt-6HJleKAuAVEsgkFir_YOFk8Zn9_ST-s0ehcf99iOSdcShWT3wZIbAOPT2oiPF1ezs44mZB-bWkqBoQ4Qh-GgsRk8IMqrlloXxFSV9T_SK23xhyqy8w2QnW4mHQg7ylDqVkKEGiXRmCB_9LoSjRNWKMGiifpz54 Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 3aba5810875541cea0a06fd5777062ff Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesGetTestJSON-1810006576 Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:53:39.811144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3aba5810875541cea0a06fd5777062ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3aba5810875541cea0a06fd5777062ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aba5810875541cea0a06fd5777062ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aba5810875541cea0a06fd5777062ff"}]}] Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesGetTestJSON-1810006576 Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 3aba5810875541cea0a06fd5777062ff Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesGetTestJSON-1810006576 Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesGetTestJSON-1810006576-project Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 9f3a1a3d6fd745418f23a2a50a704dd3 Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesGetTestJSON-1810006576-project Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Volume 2b319836-b981-4e85-a46a-31b4d968f36d could not be found. Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '2b319836-b981-4e85-a46a-31b4d968f36d'} Oct 04 08:53:39.812812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b319836-b981-4e85-a46a-31b4d968f36d could not be found. (HTTP 404) (Request-ID: req-f4975f85-e99d-4ac8-8ce6-1580f699313f) Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:39.813875 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:53:39.815242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b319836-b981-4e85-a46a-31b4d968f36d could not be found. Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:53:39.816610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b319836-b981-4e85-a46a-31b4d968f36d could not be found. Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b319836-b981-4e85-a46a-31b4d968f36d could not be found. Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d205caf1-4fc2-4a06-aac4-0af88baa149c tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] Returning 404 to user: Volume 2b319836-b981-4e85-a46a-31b4d968f36d could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d205caf1-4fc2-4a06-aac4-0af88baa149c tempest-VolumesGetTestJSON-1810006576 tempest-VolumesGetTestJSON-1810006576-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d" status: 404 len: 109 microversion: 2.1 time: 0.037839 Oct 04 08:53:39.818089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 412/799] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:53:39 2022] GET /compute/v2.1/os-volumes/2b319836-b981-4e85-a46a-31b4d968f36d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:53:39.837942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:39.845578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-630a275a-f3dc-427f-8422-0245b6b6db05 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.158493 Oct 04 08:53:39.846168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 388/800] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:39 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:40.868546 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:40.870073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:40.876062 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.876518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.876949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:40.877632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.878111 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.878531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.014964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:41.023503 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-68123f83-45bc-46fe-95ca-e0029b461d71 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1265 microversion: 2.1 time: 0.159172 Oct 04 08:53:41.024063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 413/801] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:40 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:42.046208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:42.046819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:42.052940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.053500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.053960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.054652 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.055105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.055517 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.197419 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:42.205491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1b085747-ebe1-423c-897b-f175dbef646a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1453 microversion: 2.1 time: 0.163228 Oct 04 08:53:42.206091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 389/802] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:42 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:42.228488 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:42.229022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:42.235374 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.235851 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.236283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.236956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.237402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.237861 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.256078 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=100 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:42.369608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:42.377358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e43e051f-803b-4c5f-a938-464d6df01085 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1453 microversion: 2.1 time: 0.152958 Oct 04 08:53:42.377935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 414/803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:42 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:43.975333 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-46156a41-ca27-4ffc-8f74-82857956dcbc req-bb9d448a-3456-45aa-9ef2-3971628ded5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d445b13f-7aa8-4ad3-8013-9f960b391f87", "tag": "5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:43.984884 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-46156a41-ca27-4ffc-8f74-82857956dcbc req-bb9d448a-3456-45aa-9ef2-3971628ded5e service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.985366 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-46156a41-ca27-4ffc-8f74-82857956dcbc req-bb9d448a-3456-45aa-9ef2-3971628ded5e service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.985888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-46156a41-ca27-4ffc-8f74-82857956dcbc req-bb9d448a-3456-45aa-9ef2-3971628ded5e service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.997076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-46156a41-ca27-4ffc-8f74-82857956dcbc req-bb9d448a-3456-45aa-9ef2-3971628ded5e service nova] Creating event network-changed:5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee for instance d445b13f-7aa8-4ad3-8013-9f960b391f87 on hv-cinder-86021 Oct 04 08:53:44.002242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-46156a41-ca27-4ffc-8f74-82857956dcbc req-bb9d448a-3456-45aa-9ef2-3971628ded5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031229 Oct 04 08:53:44.002860 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 390/804] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:13.567356 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:13.567969 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:13.570065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=5 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:13.570796 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:13.575743 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.576237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.576646 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.577352 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.577822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.578268 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.602351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5c84393a-0390-408e-aefe-aa8a3b5c0cef tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/ips" status: 200 len: 151 microversion: 2.1 time: 0.038814 Oct 04 08:54:13.602895 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 415/805] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:54:13 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:16.007665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=18 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:16.008431 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:16.013614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61cfc773-6abb-4254-8c04-4dc5cad85185"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:16.016081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:16.023217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.023703 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.024142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.024834 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.025288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.025741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.302142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8df23c90-ba5a-4395-a557-a7927629e36d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295835 Oct 04 08:54:16.302955 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 391/806] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:54:16 2022] POST /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:25.953844 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61cfc773-6abb-4254-8c04-4dc5cad85185"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:25.956825 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:25.959877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:25.960876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=4 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:25.967130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.967617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.968053 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.968750 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.969231 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.969655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.050174 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Invalid volume: volume 61cfc773-6abb-4254-8c04-4dc5cad85185 is already attached to instances: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: POST /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments HTTP/1.1 Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 74 Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:54:26.052404 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {"volumeAttachment": {"volumeId": "61cfc773-6abb-4254-8c04-4dc5cad85185"}} Oct 04 08:54:26.054143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Invalid volume: volume 61cfc773-6abb-4254-8c04-4dc5cad85185 is already attached to instances: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'server_id': '4e8d2b2f-7930-42d6-b6d3-5f7a282bd723', 'body': {'volumeAttachment': {'volumeId': '61cfc773-6abb-4254-8c04-4dc5cad85185'}}} Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 61cfc773-6abb-4254-8c04-4dc5cad85185 is already attached to instances: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:54:26.055101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 61cfc773-6abb-4254-8c04-4dc5cad85185 is already attached to instances: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:26.056736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 61cfc773-6abb-4254-8c04-4dc5cad85185 is already attached to instances: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 400 to user: Invalid volume: volume 61cfc773-6abb-4254-8c04-4dc5cad85185 is already attached to instances: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f5851cd5-c5dc-4f81-b178-d13ef8e96855 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104420 Oct 04 08:54:26.058444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 416/807] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:54:25 2022] POST /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:54:26.133613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:26.134330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.136863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:26.142983 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.143515 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.143958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.144651 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.145109 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.145538 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.226575 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'services' on Instance uuid 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:54:26.297913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3555c57a-d8d3-44b8-9757-5c6ac36c4499 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments/61cfc773-6abb-4254-8c04-4dc5cad85185" status: 202 len: 0 microversion: 2.1 time: 0.168569 Oct 04 08:54:26.298585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 392/808] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 08:54:26 2022] DELETE /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments/61cfc773-6abb-4254-8c04-4dc5cad85185 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:54:26.307777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:26.310482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.318815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.319309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.319786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.320524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.320976 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.321426 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.352249 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6ee51409-ffe6-4c7e-83c1-fa6f2210a17b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048460 Oct 04 08:54:26.352835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 417/809] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:54:26 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:26.919020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:26.919643 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.925838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.926319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.926755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.927438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.927887 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.928307 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.950147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lazy-loading 'flavor' on Instance uuid 2ca2be3f-0f92-4726-a2cd-b4411b5a568d {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:54:27.024227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0ce89492-ef5a-49c1-a966-21c202a2f452 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "POST /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d/action" status: 202 len: 0 microversion: 2.1 time: 0.109614 Oct 04 08:54:27.024883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 393/810] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:54:26 2022] POST /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:54:27.032962 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:27.033580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:27.040804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.041394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.041959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.043048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.043509 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.044128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.175621 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:27.183415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d5afe7be-797f-4427-87a7-23a389454ed4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.154229 Oct 04 08:54:27.183979 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 418/811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:27 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:27.366893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:27.369344 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:27.376254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.376734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.377167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.378420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.378913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.379341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.408741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8d5f80c2-4234-4671-a0ba-86f37ea43a3b tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047176 Oct 04 08:54:27.409314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 394/812] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:54:27 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:54:27.479298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:27.479889 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:27.485833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.486386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.487399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.488165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.488681 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.489267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.516420 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:54:27.605087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e0f3228d-2081-4672-aa71-631feb983386 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 204 len: 0 microversion: 2.1 time: 0.129215 Oct 04 08:54:27.606118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 419/813] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:54:27 2022] DELETE /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:54:27.614770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:27.615463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:27.622103 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.622610 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.623039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.623719 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:27.624170 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:27.624588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:27.762583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:27.771039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-728f102c-95e8-4e3a-b3c8-fe8812b7b2f8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1684 microversion: 2.1 time: 0.160712 Oct 04 08:54:27.771607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 395/814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:27 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:28.208964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:28.209715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:28.216217 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.216670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.217161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.218012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.218583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.219057 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.358405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:28.366058 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3712c283-3176-479d-b825-edf8e4e3328d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.162015 Oct 04 08:54:28.366679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 420/815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:28 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:28.796448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:28.797733 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:28.804908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.805384 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.805840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.806524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:28.806968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:28.807383 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:28.944755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:28.952867 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2dd89a75-ec55-4645-bb7f-595b67c82106 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1684 microversion: 2.1 time: 0.160327 Oct 04 08:54:28.953520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 396/816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:28 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:29.389829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:29.390437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:29.397598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:29.398311 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:29.398742 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:29.399442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:29.399886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:29.400307 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:29.538496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:29.546386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-edee3f49-1dd1-41e8-8a70-5aedc891b054 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.160313 Oct 04 08:54:29.546963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 421/817] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:29 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:29.977937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:29.979174 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:29.985707 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:29.986253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:29.986741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:29.987559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:29.988355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:29.988486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.137450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:30.146439 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ab343b34-7c8c-46cc-a593-516e33a8c2fe tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1684 microversion: 2.1 time: 0.173214 Oct 04 08:54:30.147135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 397/818] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:29 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:30.571485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:30.572133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:30.578251 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.578741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.579184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.580134 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.580321 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.581530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.676559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-0b2d42ad-13fb-4cba-a3aa-324a9302eb1d req-229165f8-2198-4e24-b043-6a52f95e7bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8d2b2f-7930-42d6-b6d3-5f7a282bd723", "name": "network-vif-deleted", "tag": "6c158308-7224-4932-8a58-e9d0bdf454eb"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:30.699831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-0b2d42ad-13fb-4cba-a3aa-324a9302eb1d req-229165f8-2198-4e24-b043-6a52f95e7bd8 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:30.700438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-0b2d42ad-13fb-4cba-a3aa-324a9302eb1d req-229165f8-2198-4e24-b043-6a52f95e7bd8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:30.702566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-0b2d42ad-13fb-4cba-a3aa-324a9302eb1d req-229165f8-2198-4e24-b043-6a52f95e7bd8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:30.721618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-0b2d42ad-13fb-4cba-a3aa-324a9302eb1d req-229165f8-2198-4e24-b043-6a52f95e7bd8 service nova] Creating event network-vif-deleted:6c158308-7224-4932-8a58-e9d0bdf454eb for instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 on hv-cinder-86021 Oct 04 08:54:30.729610 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-0b2d42ad-13fb-4cba-a3aa-324a9302eb1d req-229165f8-2198-4e24-b043-6a52f95e7bd8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058218 Oct 04 08:54:30.738280 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 398/819] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:30.767056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:30.776180 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9563d431-368e-4593-be69-b60fcf96b41a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.209787 Oct 04 08:54:30.777196 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 422/820] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:30 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:31.171265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:31.171964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:31.179689 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.180470 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.180903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.181798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.182252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.182670 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.216273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.217013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.217437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.218064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'fault' on Instance uuid 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:54:31.273194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:31.286601 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8f834766-8403-40bf-abc4-f68223cc727f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 200 len: 1332 microversion: 2.1 time: 0.119521 Oct 04 08:54:31.287209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 399/821] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:31 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:31.805418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:31.806655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:31.813318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.813842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.814282 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:31.815646 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:31.816120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:31.816531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.045159 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:32.053584 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3908817a-9a8b-416a-97cd-d873b2f5c26e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.251957 Oct 04 08:54:32.054265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 423/822] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:31 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:32.309579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:32.310362 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:32.317514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.318094 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.318535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.319224 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:32.319703 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:32.320119 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:32.334029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 HTTP/1.1 Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:54:32.336113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:54:32.337542 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '4e8d2b2f-7930-42d6-b6d3-5f7a282bd723'} Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:54:32.338395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:54:32.339716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:54:32.340863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:54:32.340863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0bfb39f7-bb45-43c1-851f-4ea1f0cce95e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 404 len: 111 microversion: 2.1 time: 0.032223 Oct 04 08:54:32.340863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 400/823] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:32 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:54:32.347270 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-80102756-1bec-4c62-bb2e-dc44fc7695ab tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '.version_select at 0x7f5fd4149d30>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:32.367425 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-80102756-1bec-4c62-bb2e-dc44fc7695ab tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707279528" status: 202 len: 0 microversion: 2.1 time: 0.024330 Oct 04 08:54:32.368003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 424/824] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 08:54:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707279528 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:54:32.993093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1044da4c-d21a-4472-8ffe-dddb9e432431 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: .version_select at 0x7f5fd7b89700>, body: {"keypair": {"name": "tempest-keypair-1250082675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/IeGFukoNCfOxcE9dkie1u7FFDWdMKsFg2Gk/cWj9x3ldUDXsSeFiTij+SN/+zRgE++bHtwJ+V9tLBCBWShXbkYOerMLmo5RBsuRnAIxQf91iQt6IsezaOGcwSdNb4+Q=="}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:33.007942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-1044da4c-d21a-4472-8ffe-dddb9e432431 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:33.012067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-1044da4c-d21a-4472-8ffe-dddb9e432431 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:33.034610 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1044da4c-d21a-4472-8ffe-dddb9e432431 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045291 Oct 04 08:54:33.035192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 401/825] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:54:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:33.076937 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:33.077678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:33.085659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:33.086171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:33.086607 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:33.087332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:33.087742 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:33.088171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:33.287734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:33.296501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f169543d-4009-4672-bcb7-2fe3a0eb8fc9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.223616 Oct 04 08:54:33.307085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 425/826] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:33 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:34.323324 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:34.325266 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:34.335932 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:34.336912 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:34.337714 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:34.338673 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:34.339216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:34.339708 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:34.547593 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:34.567973 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-606b9915-f55a-448e-967e-322d13a8964f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.249579 Oct 04 08:54:34.568556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 402/827] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:34 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:34.753440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-915026072", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbaa5ae-9515-4efe-ae61-91971a7f125f"}], "security_groups": [{"name": "tempest-securitygroup--1823067962"}], "key_name": "tempest-keypair-1250082675", "user_data": "}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:34.870429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] validate_networks() for [('fbbaa5ae-9515-4efe-ae61-91971a7f125f', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:54:35.260415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:54:35.261048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:54:35.261569 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:54:35.262243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:54:35.262667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:54:35.272184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.272680 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.273117 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.273876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.274332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.274757 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.292754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:35.296733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Getting quotas for user 3c0b7528b0ff4b09923a0e951d052ed5 and project 9bd782f79ed84b81a998ae437af2a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:35.308769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:54:35.311128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:54:35.364213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-78d3508e-c019-4a98-b9d2-9fe43fbd56c2 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.615418 Oct 04 08:54:35.364941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 426/828] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:54:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:54:35.376536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-02976d3a-8fa2-499f-af1e-37d9a9fd5cf1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.377195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-02976d3a-8fa2-499f-af1e-37d9a9fd5cf1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.440893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-02976d3a-8fa2-499f-af1e-37d9a9fd5cf1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:35.456030 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-02976d3a-8fa2-499f-af1e-37d9a9fd5cf1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1241 microversion: 2.1 time: 0.082895 Oct 04 08:54:35.472394 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 403/829] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:35.591380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.592000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.599181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.599676 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.600118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.600848 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.601511 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.602167 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.771773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:35.780179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b67eb1cf-dfba-4221-9bf4-b35a28455ff2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.192714 Oct 04 08:54:35.780777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 427/830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:36.480566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:36.481405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:36.491131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.491872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.492380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.493168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.493715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.494205 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.560550 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.569025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6306eb20-ec89-471f-aba9-8abc40321d74 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1293 microversion: 2.1 time: 0.092435 Oct 04 08:54:36.569939 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 404/831] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:36 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:36.804748 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:36.805422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:36.812026 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.812443 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.812876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.813609 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:36.814111 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:36.815146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.020493 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.034255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9538c51c-6e95-421c-a4a4-e2efd6572734 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.233283 Oct 04 08:54:37.035003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 428/832] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:36 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:37.594015 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:37.594628 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:37.601721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.602216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.602658 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.603356 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.603799 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.604237 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.732509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.741774 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-de4ef334-8f21-47e1-b421-1736142a001d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.151587 Oct 04 08:54:37.742352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 405/833] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:37 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:38.058996 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.059617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.065798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.066285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.066723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.067413 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.067864 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.068306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.296326 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.304499 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b529e5e6-7a7c-4327-8d12-c7d826299ad9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.249518 Oct 04 08:54:38.305286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 429/834] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:38.409304 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-37074312-e212-4d77-9a66-94df37861cf2 req-1554a9c1-c456-455b-a1d0-136497cd67c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68fb3f4-71f4-4682-9688-f6e821feef01", "tag": "0f0bdbdb-f916-4e99-9b5d-4646d71679d7"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:38.421372 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-37074312-e212-4d77-9a66-94df37861cf2 req-1554a9c1-c456-455b-a1d0-136497cd67c5 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.422355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-37074312-e212-4d77-9a66-94df37861cf2 req-1554a9c1-c456-455b-a1d0-136497cd67c5 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.423037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-37074312-e212-4d77-9a66-94df37861cf2 req-1554a9c1-c456-455b-a1d0-136497cd67c5 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.435742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-37074312-e212-4d77-9a66-94df37861cf2 req-1554a9c1-c456-455b-a1d0-136497cd67c5 service nova] Creating event network-changed:0f0bdbdb-f916-4e99-9b5d-4646d71679d7 for instance f68fb3f4-71f4-4682-9688-f6e821feef01 on hv-cinder-86021 Oct 04 08:54:38.442449 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-37074312-e212-4d77-9a66-94df37861cf2 req-1554a9c1-c456-455b-a1d0-136497cd67c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037059 Oct 04 08:54:38.443323 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 406/835] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:38.765658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.766298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.772380 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.772863 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.773294 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.774128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.774487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.775086 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.977477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.988789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8f1b179b-38aa-49e6-ba4f-c8e5ece18625 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.226869 Oct 04 08:54:38.989531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 430/836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:39.330661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:39.331296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:39.337898 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.338399 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.338849 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.339567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.340020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.340476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.344603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:39.481474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.489168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9878efad-7529-40e2-a90b-d275b5b77771 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.164139 Oct 04 08:54:39.489745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 407/837] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:39 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:40.012748 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:40.013352 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:40.020282 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.020768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.021226 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.021936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.022390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.022816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.160460 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:40.168228 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-fe4877f9-4036-4858-84c5-71f4e94f28cf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.159346 Oct 04 08:54:40.168807 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 431/838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:40 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:40.511820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:40.512446 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:40.518866 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.519344 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.519771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.520452 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.520897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.521315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.659691 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:40.669230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-68479ab6-ecd7-4ece-8409-3350ba0e637d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.161312 Oct 04 08:54:40.669942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 408/839] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:40 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:41.191506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:41.192735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:41.199450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.199933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.200364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.201056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.201500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.202125 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.220932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:41.362425 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.371309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-af357957-932c-4e34-b0f4-a791fdc19248 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.184535 Oct 04 08:54:41.371887 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 432/840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:41 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:41.693081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:41.693566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:41.700095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.700572 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.700994 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.701901 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.702349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.702768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.849195 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.857067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b4878ae3-585c-4440-9a6f-1ae0b4bcbb03 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.168441 Oct 04 08:54:41.857845 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 409/841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:41 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:42.394662 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:42.396041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:42.403045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.403614 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.404309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.404790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.405282 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.405914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.642771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.659081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a283028d-81ad-4469-9d78-3cea6b721514 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.267647 Oct 04 08:54:42.659973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 433/842] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:42 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:42.881721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:42.882341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:42.888949 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.889606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.890071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.891241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.891854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.892917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.040169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.049661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e82d3212-fbdd-4f79-b837-f74f87b27543 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.173094 Oct 04 08:54:43.050398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 410/843] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:42 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:43.682214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:43.682841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:43.690890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.691390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.691827 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.692530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.692986 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.693408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.822757 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.830413 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f6b26b89-c43f-43fa-8467-076ce9b4deec tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.152289 Oct 04 08:54:43.830978 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 434/844] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:43 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:44.073712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:44.074432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.081204 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.081676 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.082152 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.082836 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.083549 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.083960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.210822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:44.218379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4a321ae1-0a02-4841-847a-46c7757521e9 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.148517 Oct 04 08:54:44.218940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 411/845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:44 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:44.853592 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:44.854504 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.861333 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.861880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.862320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.863038 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.863691 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.864144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.002637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.014745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-40c5f7a5-79c4-4e49-98fd-76d88205dfc8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.164976 Oct 04 08:54:45.016151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 435/846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:44 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:45.241681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:45.242326 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.249138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.249836 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.250455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.251827 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.252293 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.252892 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.413557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.421515 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0e600b86-143d-4c4e-ae80-014574248516 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1569 microversion: 2.1 time: 0.183934 Oct 04 08:54:45.422126 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 412/847] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:45 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:45.446119 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:45.446722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.448527 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:45.449300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:45.455624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.456036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.456463 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.457148 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.457591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.458329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.502892 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126938) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 08:54:45.526393 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-f82a6ad4-6bf4-481d-a633-747995b113a7 req-e4f0193f-e997-4e78-9ba4-db07bec0f243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68fb3f4-71f4-4682-9688-f6e821feef01", "name": "network-vif-plugged", "status": "completed", "tag": "0f0bdbdb-f916-4e99-9b5d-4646d71679d7"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:45.532752 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:45.540327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-f82a6ad4-6bf4-481d-a633-747995b113a7 req-e4f0193f-e997-4e78-9ba4-db07bec0f243 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.540821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-f82a6ad4-6bf4-481d-a633-747995b113a7 req-e4f0193f-e997-4e78-9ba4-db07bec0f243 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.541255 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-f82a6ad4-6bf4-481d-a633-747995b113a7 req-e4f0193f-e997-4e78-9ba4-db07bec0f243 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.555017 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-f82a6ad4-6bf4-481d-a633-747995b113a7 req-e4f0193f-e997-4e78-9ba4-db07bec0f243 service nova] Creating event network-vif-plugged:0f0bdbdb-f916-4e99-9b5d-4646d71679d7 for instance f68fb3f4-71f4-4682-9688-f6e821feef01 on hv-cinder-86021 Oct 04 08:54:45.560073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-f82a6ad4-6bf4-481d-a633-747995b113a7 req-e4f0193f-e997-4e78-9ba4-db07bec0f243 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038521 Oct 04 08:54:45.560878 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 413/848] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:45.576185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-29e3bfd6-a990-405e-9c82-ec249daca487 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "POST /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d/action" status: 202 len: 0 microversion: 2.1 time: 0.133954 Oct 04 08:54:45.576792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 436/849] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:54:45 2022] POST /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:54:45.586088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:45.586963 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.602886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.603530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.604078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.606295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.606783 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.607229 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.796996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.807978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-027e5365-d071-4e18-829e-03cf9d779d64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1577 microversion: 2.1 time: 0.226802 Oct 04 08:54:45.808587 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 414/850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:45 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:46.040118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:46.040844 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:46.046941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.047426 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.047862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.049166 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.049610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.050062 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.180042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:46.188025 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4f90e2da-d4a1-488a-a1bc-a15296d8b1f4 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.152812 Oct 04 08:54:46.188594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 437/851] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:46 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:46.832334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:46.833409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:46.840066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.840480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.840916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.841613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.842098 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.842535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.047262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:47.058672 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-92ebfa9d-3c76-4964-9a2f-a02d64d3db65 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1519 microversion: 2.1 time: 0.230828 Oct 04 08:54:47.059249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 415/852] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:46 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:47.165612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:47.166173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:47.172957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.173972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.174468 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.175200 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.175660 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.176092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.200701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7853bfc5-bdc9-4a44-a46f-2df60b745167 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/ips" status: 200 len: 150 microversion: 2.20 time: 0.039532 Oct 04 08:54:47.202176 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 438/853] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Oct 4 08:54:47 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:54:47.214055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:47.214693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:47.229741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.230485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.230977 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.231736 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.232193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.232650 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.654584 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:47.670046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2a0bbd2d-66c4-4289-b171-3f6e4d193cd9 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1367 microversion: 2.1 time: 0.462809 Oct 04 08:54:47.670628 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 416/854] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:47 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:48.082706 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:48.083584 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:48.090044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.090822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.091261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.091945 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.092402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.092816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.241594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.249849 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8bdd57c2-dbcf-4be0-abed-a25d1be94ad1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1519 microversion: 2.1 time: 0.171493 Oct 04 08:54:48.250824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 439/855] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:48 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:48.695610 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:48.696646 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:48.704044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.704649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.705375 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.706176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.706919 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.707408 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.851330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.860201 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b16c474a-d2bf-4ecc-8efb-cb81e0772ef7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1557 microversion: 2.1 time: 0.168643 Oct 04 08:54:48.861358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 417/856] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:48 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:48.887511 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:48.888097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:48.894401 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.894882 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.895958 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.896660 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.897287 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.897752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.004094 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e0ac84d3-0f9c-4bee-9dee-37c3ea5b1e9e tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121187 Oct 04 08:54:49.005113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 440/857] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 08:54:48 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:49.081511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:49.082334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:49.088704 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.089310 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.089970 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.090786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.091340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.091868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.124379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lazy-loading 'flavor' on Instance uuid 4079470a-d577-4b42-810b-e864cdd7754a {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:54:49.274880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:49.275509 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:49.283273 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.283917 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.284454 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.285261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.285981 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.286631 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.360167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f6b0f5fb-0ce1-4193-a466-325a36a09d26 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/action" status: 202 len: 0 microversion: 2.20 time: 0.282197 Oct 04 08:54:49.361914 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 418/858] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 08:54:49 2022] POST /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:54:49.371234 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:49.372450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:49.380319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.381276 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.393585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.394734 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.395227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.395675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.556402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.565345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.567340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.568655 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c799ea3d-047f-4175-83b0-a06d402b8a8b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.202189 Oct 04 08:54:49.569600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 419/859] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:49 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:49.574592 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-b5dfd1f0-82a0-4e42-99d9-261de90e32fc req-faa1a748-2113-4249-98fd-d050770b4eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2be3f-0f92-4726-a2cd-b4411b5a568d", "name": "network-vif-unplugged", "status": "completed", "tag": "62e424ab-6247-49c9-940d-ec255b6199a8"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:49.586413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b5dfd1f0-82a0-4e42-99d9-261de90e32fc req-faa1a748-2113-4249-98fd-d050770b4eb8 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.587221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b5dfd1f0-82a0-4e42-99d9-261de90e32fc req-faa1a748-2113-4249-98fd-d050770b4eb8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.587926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b5dfd1f0-82a0-4e42-99d9-261de90e32fc req-faa1a748-2113-4249-98fd-d050770b4eb8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.602578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-b5dfd1f0-82a0-4e42-99d9-261de90e32fc req-faa1a748-2113-4249-98fd-d050770b4eb8 service nova] Creating event network-vif-unplugged:62e424ab-6247-49c9-940d-ec255b6199a8 for instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d on hv-cinder-86021 Oct 04 08:54:49.607663 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-b5dfd1f0-82a0-4e42-99d9-261de90e32fc req-faa1a748-2113-4249-98fd-d050770b4eb8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036446 Oct 04 08:54:49.608260 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 420/860] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:49.798652 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.806756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-148a6191-530f-40d3-9dbe-bd26b77a6836 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.535638 Oct 04 08:54:49.807452 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 441/861] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:49 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:50.599750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:50.600944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:50.607268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.607951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.608377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.609243 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.610076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.611085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.758361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.767885 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.769339 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.770540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-329c7694-6047-44cf-8e98-780b1c0cfc1b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.175829 Oct 04 08:54:50.771086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 421/862] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:50 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:50.832004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:50.832606 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:50.839356 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.839902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.840337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.841087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.841542 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.841992 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.088033 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-e066ff46-cda2-4d3f-9dfd-1d1b7cae503e req-eba32548-75af-45a7-b3aa-3e59471bef22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68fb3f4-71f4-4682-9688-f6e821feef01", "tag": "0f0bdbdb-f916-4e99-9b5d-4646d71679d7"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:51.102348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e066ff46-cda2-4d3f-9dfd-1d1b7cae503e req-eba32548-75af-45a7-b3aa-3e59471bef22 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.102930 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e066ff46-cda2-4d3f-9dfd-1d1b7cae503e req-eba32548-75af-45a7-b3aa-3e59471bef22 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.103578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-e066ff46-cda2-4d3f-9dfd-1d1b7cae503e req-eba32548-75af-45a7-b3aa-3e59471bef22 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.117518 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-e066ff46-cda2-4d3f-9dfd-1d1b7cae503e req-eba32548-75af-45a7-b3aa-3e59471bef22 service nova] Creating event network-changed:0f0bdbdb-f916-4e99-9b5d-4646d71679d7 for instance f68fb3f4-71f4-4682-9688-f6e821feef01 on hv-cinder-86021 Oct 04 08:54:51.124853 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-e066ff46-cda2-4d3f-9dfd-1d1b7cae503e req-eba32548-75af-45a7-b3aa-3e59471bef22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043631 Oct 04 08:54:51.126720 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 422/863] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:51.153447 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.164363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1053877f-0d31-4772-af16-4c3cd25da632 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.337337 Oct 04 08:54:51.173725 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 442/864] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:50 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:51.797386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:51.798730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:51.809767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.810557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.810895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.811612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.812232 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.812654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.990640 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.994607 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:52.001185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.003239 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.004840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cea7101d-c2cc-4b58-9471-6cb9e6d543b1 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.212206 Oct 04 08:54:52.005741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 423/865] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:51 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:52.187717 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:52.188548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:52.195439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.195944 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.196388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.197115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.197573 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.198204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.431612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.439396 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-89285547-f4da-4c3c-bf8d-858ffbbba125 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.255604 Oct 04 08:54:52.439898 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 443/866] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:52 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:53.032851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.033463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.040978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.041461 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.041927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.042622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.043089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.043504 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.175647 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.183699 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.185129 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.186301 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bdde1017-abc4-43e4-b15d-870f857e37d2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.158100 Oct 04 08:54:53.186850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 424/867] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:53.463351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.463968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.470878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.471361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.471797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.472481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.472987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.473415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.600512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.608114 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-55720644-0cad-47a1-8849-ed07dddb3b1d tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.148711 Oct 04 08:54:53.608678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 444/868] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:54.212884 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:54.213486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:54.219851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.220386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.220854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.221626 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.222100 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.222527 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.350777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.359033 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.360485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.361625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6a413ef7-9e4f-4b24-be2a-f8570151d4e6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.152662 Oct 04 08:54:54.362197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 425/869] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:54 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:54.632634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:54.633193 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:54.639719 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.640415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.640641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.641321 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.641796 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.642218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.779540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.788342 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-8635cac5-e6ef-4613-9f5b-13596cdf62d2 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.160151 Oct 04 08:54:54.788769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 445/870] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:54 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:55.387255 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:55.387859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:55.394282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.394784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.395214 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.395947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.396391 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.396807 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.527192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.535967 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.537578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.538745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5d50073e-5058-46f9-9420-5582de020fd9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.155711 Oct 04 08:54:55.539297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 426/871] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:55 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:55.811440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:55.812048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:55.819100 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.819591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.820012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.820693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.821146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.821566 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.951772 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.960146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b0b98b91-b561-4565-bf86-705ff822968f tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.152574 Oct 04 08:54:55.960704 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 446/872] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:55 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:56.565491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:56.566065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:56.568918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:56.574052 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.574533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.574972 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.575660 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.576111 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.576533 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.707184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:56.715886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:56.717385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:56.718616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ff4886fe-3c8e-44c2-bf2e-61cfa8a87617 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.157264 Oct 04 08:54:56.719209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 427/873] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:56 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:56.984580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:56.985120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:56.987382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:56.993478 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.993979 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.994412 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.995087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.995535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.995952 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:57.129619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.137422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a5f14c37-69e5-43ea-965d-7e2109fd107e tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.156817 Oct 04 08:54:57.138012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 447/874] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:56 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:57.744378 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:57.744991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:57.751484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:57.752217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:57.752425 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:57.753233 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:57.754396 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:57.754487 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:57.886138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.894138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.895664 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.896828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8af57a52-9d2e-404d-9425-b5e8e188b290 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.156400 Oct 04 08:54:57.897411 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 428/875] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:57 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:58.160925 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:58.161535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:58.168073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.168558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.168990 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.169678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.170152 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.170575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.297023 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:58.300405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:58.305392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-58196fd7-2788-4f53-b0d7-039f98ed28fa tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.148961 Oct 04 08:54:58.305980 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 448/876] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:58 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:58.922477 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:58.923035 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:58.929892 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.930370 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.930797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.931470 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.931913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.932332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.057067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:59.065105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:59.067208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:59.068386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0ec9c934-bd1a-4d66-a18f-b60d4d621016 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.149851 Oct 04 08:54:59.068948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 429/877] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:58 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:59.328157 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:59.328775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:59.337034 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.337518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.338097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.338794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.339246 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.339669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.474331 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:59.481944 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b64c8f77-2cc8-4525-b0e3-fa6d86918b64 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.157610 Oct 04 08:54:59.482498 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 449/878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:59 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:00.094032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:00.094828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:00.101925 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.102412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.102847 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.103551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.104001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.104420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.236875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.245630 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.247082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.248312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f59eb787-c2a0-4657-9685-a296af6d5be5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.158279 Oct 04 08:55:00.248871 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 430/879] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:00 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:00.505447 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:00.505997 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:00.512291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.512767 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.513191 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.513901 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.514349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.514874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.645802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.653920 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2b954376-0f20-424d-b0c6-daf663019251 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.152301 Oct 04 08:55:00.654499 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 450/880] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:00 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:01.274475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:01.275081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:01.281435 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.281938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.282376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.283081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.283508 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.283927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.414991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.423223 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.424753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.426050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-77c11534-7cc3-4b00-996f-00b3e0631b5a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1743 microversion: 2.20 time: 0.155445 Oct 04 08:55:01.426682 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 431/881] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:01 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:01.677628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:01.678291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:01.684890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.685417 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.685908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.686605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.687063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.687541 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.817189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.825259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a414aec8-e052-457f-a2a2-0e4a7e55cf51 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.151606 Oct 04 08:55:01.825894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 451/882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:01 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:02.451873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:02.452520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:02.459265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.459778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.460214 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.460894 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.461341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.461785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.589472 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.598121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.599561 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.600718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-35525b2f-fec3-428b-b173-b383055686c8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1743 microversion: 2.20 time: 0.152842 Oct 04 08:55:02.601277 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 432/883] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:02 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:02.849751 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:02.850289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:02.856635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.857113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.857547 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.858256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.858705 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.859125 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.988897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.996493 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-bc4fccfe-c80e-4e92-969f-915ffec41de4 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.151350 Oct 04 08:55:02.997050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 452/884] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:02 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:03.626590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:03.627200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:03.634106 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.634586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.635023 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.635715 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.636168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.636589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.767984 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:03.779681 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-4d097be0-12fa-4205-a5ba-f6a27b26b20c req-953b2584-de8f-47f2-ac49-bd45c54bc372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2be3f-0f92-4726-a2cd-b4411b5a568d", "name": "network-vif-plugged", "status": "completed", "tag": "62e424ab-6247-49c9-940d-ec255b6199a8"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:03.787820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:03.789263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:03.790537 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-14fdc92d-b03a-49ec-9a36-5e7b92d938be tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1743 microversion: 2.20 time: 0.167836 Oct 04 08:55:03.791049 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 433/885] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:03 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:03.794814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-4d097be0-12fa-4205-a5ba-f6a27b26b20c req-953b2584-de8f-47f2-ac49-bd45c54bc372 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.795298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-4d097be0-12fa-4205-a5ba-f6a27b26b20c req-953b2584-de8f-47f2-ac49-bd45c54bc372 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.795729 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-4d097be0-12fa-4205-a5ba-f6a27b26b20c req-953b2584-de8f-47f2-ac49-bd45c54bc372 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.810688 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-4d097be0-12fa-4205-a5ba-f6a27b26b20c req-953b2584-de8f-47f2-ac49-bd45c54bc372 service nova] Creating event network-vif-plugged:62e424ab-6247-49c9-940d-ec255b6199a8 for instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d on hv-cinder-86021 Oct 04 08:55:03.815636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-4d097be0-12fa-4205-a5ba-f6a27b26b20c req-953b2584-de8f-47f2-ac49-bd45c54bc372 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039698 Oct 04 08:55:03.816932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 453/886] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:04.020528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:04.021522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:04.027479 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.027964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.028398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.029097 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.029553 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.030002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.172121 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:04.180013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-40ef865b-3929-4c50-8325-41effef74248 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.163971 Oct 04 08:55:04.180784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 434/887] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:04 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:04.817113 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:04.817831 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:04.823930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.824410 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.824843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.825529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.826013 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.826440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.111225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:05.119794 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:05.121242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:05.122500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4625cac3-f302-4d28-901b-4f09997d32f4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1743 microversion: 2.20 time: 0.310663 Oct 04 08:55:05.123050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 454/888] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:04 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1743 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:05.202410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:05.203018 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:05.209768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.210251 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.210677 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.211361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.211802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.212216 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.338445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:05.346009 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bdca08ff-c59c-44cb-baba-902094e3e54a tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.147337 Oct 04 08:55:05.346568 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 435/889] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:05 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:05.830439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-675d3f95-06ee-4b1b-9706-98213ce9987e req-85602510-979c-49a8-b950-6853c31a261d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4079470a-d577-4b42-810b-e864cdd7754a", "name": "network-vif-plugged", "status": "completed", "tag": "a483e39a-a337-488b-8e99-afe48bd9970b"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:05.840916 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-675d3f95-06ee-4b1b-9706-98213ce9987e req-85602510-979c-49a8-b950-6853c31a261d service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.841395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-675d3f95-06ee-4b1b-9706-98213ce9987e req-85602510-979c-49a8-b950-6853c31a261d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.841858 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-675d3f95-06ee-4b1b-9706-98213ce9987e req-85602510-979c-49a8-b950-6853c31a261d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.853171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-675d3f95-06ee-4b1b-9706-98213ce9987e req-85602510-979c-49a8-b950-6853c31a261d service nova] Creating event network-vif-plugged:a483e39a-a337-488b-8e99-afe48bd9970b for instance 4079470a-d577-4b42-810b-e864cdd7754a on hv-cinder-86021 Oct 04 08:55:05.857914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-675d3f95-06ee-4b1b-9706-98213ce9987e req-85602510-979c-49a8-b950-6853c31a261d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031095 Oct 04 08:55:05.858453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 455/890] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:06.149078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:06.149705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:06.155578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.156054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.156482 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.157160 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.157606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.158095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.290582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.298556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.300018 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.301790 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-943204e5-1417-4602-b2e4-e3fd8a6ef08e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1743 microversion: 2.20 time: 0.156659 Oct 04 08:55:06.302344 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 436/891] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:06 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:06.370196 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:06.370900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:06.377612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.378135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.378577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.379274 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.379726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.380151 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.508888 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.516581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cc686a0d-071e-4011-8a0e-8fd16c6d9f83 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1575 microversion: 2.1 time: 0.150579 Oct 04 08:55:06.517144 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 456/892] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:06 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:07.328477 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.329087 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.335864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.336345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.336777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.337461 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.337938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.338359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.466363 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.474352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.475793 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.476940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4b3bcc0e-8daa-4704-9082-128d4bc8143d tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1743 microversion: 2.20 time: 0.152411 Oct 04 08:55:07.477491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 437/893] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:07.541030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.541635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.548007 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.548487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.548919 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.549600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.550722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.551193 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.685665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.693572 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-98422fba-4c52-44e0-9c95-4d94b5b9c4ed tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1562 microversion: 2.1 time: 0.156327 Oct 04 08:55:07.694254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 457/894] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:08.506957 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:08.507702 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:08.527977 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.528472 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.528913 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.529948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.530920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.531918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.692486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.702281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.703656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.705167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2aee2331-9cc5-48fb-815e-07ac4cca1e04 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.204918 Oct 04 08:55:08.706633 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 438/895] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:08 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:09.740469 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:09.741772 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:09.751644 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.752554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.753750 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.754518 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.755192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.755756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.897065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.906900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.908437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.909650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cb474246-c72d-4ae1-8c2c-edc7bd545705 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.179485 Oct 04 08:55:09.910398 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 458/896] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:09 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:10.939649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:10.940253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:10.947450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.947935 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.948581 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.949458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.949937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.950559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:11.096082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.105796 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.107256 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.108413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7863eb61-135b-435c-ab4c-57e5e3441a4a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.175798 Oct 04 08:55:11.108979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 439/897] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:10 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:12.134285 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:12.134890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:12.142058 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.142803 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.143414 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.144657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.145120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.145547 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.286129 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:12.294600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:12.296050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:12.297227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3550946a-78db-45c2-93c8-02f46e069f24 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.166948 Oct 04 08:55:12.309709 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 459/898] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:12 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:13.322975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:13.323578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:13.330059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:13.330539 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:13.331067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:13.331851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:13.332562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:13.333105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:13.353021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=100 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:13.471413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.479987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.481640 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.482850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c8837c73-0788-4382-a1f8-093e5d8d3505 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.163671 Oct 04 08:55:13.483410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 440/899] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:13 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:14.509536 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:14.511159 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:14.518140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.519264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.519702 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.520433 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.520865 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.521560 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.937559 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.946521 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.947987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.949176 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ee79469e-c67b-404f-85ed-7a105dd99462 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.444081 Oct 04 08:55:14.949943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 460/900] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:14 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:15.975875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:15.976462 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:15.982766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.983247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.983722 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.984395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.984854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.985295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.138003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:16.148039 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:16.149495 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:16.150872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4f104174-db81-4935-8dca-cb407bac46fd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.179298 Oct 04 08:55:16.152254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 441/901] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:15 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:17.177445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:17.178956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:17.189179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:17.189782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:17.190361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:17.191084 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:17.191609 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:17.192099 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:17.341206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.349994 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.351450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.352701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5e97d288-af28-427b-b60a-6bf53c5579f2 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.180000 Oct 04 08:55:17.353283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 461/902] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:17 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:18.379948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:18.380561 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:18.387663 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.388147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.388826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.389756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.390370 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.390962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.529304 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.538578 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.540025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.541188 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e70d7add-44f7-484d-887d-1217eb3e210b tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.166266 Oct 04 08:55:18.541756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 442/903] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:18 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:19.567148 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:19.567758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:19.574363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.574848 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.575282 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.575969 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.576421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.576880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.709402 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.717483 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.718946 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.720109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-94ce9171-8185-4bba-b3fa-7ee599add9bf tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1738 microversion: 2.20 time: 0.156903 Oct 04 08:55:19.720642 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 462/904] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:19 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:20.747730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:20.748332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:20.755307 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.755783 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.756222 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.756895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.757340 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.757782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.886629 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.894535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.895962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.897102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-86c030ae-d31d-472a-a148-e7ff7e298d56 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1720 microversion: 2.20 time: 0.153287 Oct 04 08:55:20.897645 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 443/905] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:20 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:21.922692 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:21.923253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:21.930349 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.930831 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.931267 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:21.931960 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.932410 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.932833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:22.062257 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:22.070244 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:22.071693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:22.072856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d956548d-7199-4478-8015-9800346f0d1a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1720 microversion: 2.20 time: 0.154188 Oct 04 08:55:22.073416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 463/906] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:21 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:23.098559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:23.099189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:23.105559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.106065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.106496 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.107173 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.107618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.108036 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.235159 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:23.243915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:23.245841 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:23.247269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6acef018-de5e-420f-87db-d57950420098 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1663 microversion: 2.20 time: 0.152446 Oct 04 08:55:23.247679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 444/907] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:23 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:23.272754 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7391093-6036-4815-b121-e93edf542daf"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:23.275526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:23.282171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.282597 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.283029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.284246 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.285171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.285595 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.538289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:23.551733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4dd8f547-b76e-4570-b723-c1326e259914 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283284 Oct 04 08:55:23.552325 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 464/908] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Oct 4 08:55:23 2022] POST /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-volume_attachments => generated 188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:55:23.674748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:23.675228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:23.681029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.681507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.681968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.682682 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.683134 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.683555 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.792562 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-16a5fb56-a970-484a-8dd5-ae62bb7dce5c req-c92017b1-3709-4f4d-90ef-63e877adf4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4079470a-d577-4b42-810b-e864cdd7754a", "name": "network-vif-unplugged", "status": "completed", "tag": "a483e39a-a337-488b-8e99-afe48bd9970b"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:23.805368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-16a5fb56-a970-484a-8dd5-ae62bb7dce5c req-c92017b1-3709-4f4d-90ef-63e877adf4f0 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.806140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-16a5fb56-a970-484a-8dd5-ae62bb7dce5c req-c92017b1-3709-4f4d-90ef-63e877adf4f0 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.806896 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-16a5fb56-a970-484a-8dd5-ae62bb7dce5c req-c92017b1-3709-4f4d-90ef-63e877adf4f0 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.818534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.compute.server_external_events [req-16a5fb56-a970-484a-8dd5-ae62bb7dce5c req-c92017b1-3709-4f4d-90ef-63e877adf4f0 service nova] Unable to find a host for instance 4079470a-d577-4b42-810b-e864cdd7754a. Dropping event network-vif-unplugged {{(pid=126938) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 08:55:23.819516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-16a5fb56-a970-484a-8dd5-ae62bb7dce5c req-c92017b1-3709-4f4d-90ef-63e877adf4f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031733 Oct 04 08:55:23.820186 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 465/909] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 08:55:23.940752 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c1327efc-3423-41b9-9abf-aa6e8f2b13aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-volume_attachments/c7391093-6036-4815-b121-e93edf542daf" status: 202 len: 0 microversion: 2.20 time: 0.269995 Oct 04 08:55:23.941336 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 445/910] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Oct 4 08:55:23 2022] DELETE /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-volume_attachments/c7391093-6036-4815-b121-e93edf542daf => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:55:24.001468 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:24.002591 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:24.008386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.008860 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.009287 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:24.010005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.010451 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.010872 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:24.039669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126938) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 08:55:24.103799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5cd6555c-4898-4f76-a1c3-c9f9a589e419 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "POST /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/action" status: 202 len: 0 microversion: 2.20 time: 0.105971 Oct 04 08:55:24.104407 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 466/911] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 08:55:23 2022] POST /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:55:24.115112 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:24.115755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:24.122881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.123356 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.123780 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:24.124464 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.124908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.125322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:24.262570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:24.275332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:24.276813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:24.278064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-430ce9a3-4da5-405f-9bdc-72cac358dd65 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1671 microversion: 2.20 time: 0.167338 Oct 04 08:55:24.278622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 446/912] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:24 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:25.304683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:25.305300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:25.311482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.311997 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:25.312431 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.313125 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.313570 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:25.314035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.446214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:25.454392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:25.455850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:25.457288 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-00ae6a0f-b09d-4f40-b771-4fa150912277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1673 microversion: 2.20 time: 0.156856 Oct 04 08:55:25.458049 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 467/913] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:25 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:26.482791 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:26.483405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:26.490483 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:26.490963 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:26.491400 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:26.492086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:26.492540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:26.492964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:26.779389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:26.788938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:26.791501 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:26.793230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f5f0f8ba-1e3b-46cd-b1af-72f4b9cbd60a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.314404 Oct 04 08:55:26.794144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 447/914] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:26 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:27.823207 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:27.823818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:27.826327 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:27.832519 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:27.833007 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:27.833440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:27.834172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:27.834622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:27.835038 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:27.962424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.970498 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.972453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.973604 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d29dbd29-f494-4cff-bb85-236eef48393e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.154315 Oct 04 08:55:27.974185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 468/915] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:27 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:28.999587 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:29.000122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:29.002499 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=42 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:29.007742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.008229 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.008665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.009390 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.009867 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.010291 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.141262 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:29.149859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:29.151313 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:29.152476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-44471c4d-5312-4207-8521-27d227ff55aa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.156823 Oct 04 08:55:29.153019 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 448/916] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:28 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:30.179679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:30.180599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:30.187315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.187795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.188229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.188948 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.189418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.189878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.343156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.354157 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.360869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.362693 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c854db0c-ac32-4321-aa3d-64c6cc880dac tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.187488 Oct 04 08:55:30.363249 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 469/917] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:30 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:31.388583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:31.389241 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:31.396901 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.397475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.397994 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:31.398786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.399327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.399812 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:31.538541 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:31.547056 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:31.548522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:31.550300 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8ff6d529-658e-4d4f-a928-f74ac886b38a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.165654 Oct 04 08:55:31.550852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 449/918] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:31 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:32.576325 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:32.577032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:32.584195 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:32.584683 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:32.585123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:32.585855 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:32.586319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:32.586752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:32.727139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.735441 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.736904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.738102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0f05db04-cc57-43ed-a766-9ccc375fab3e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.165827 Oct 04 08:55:32.738665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 470/919] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:32 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:33.765376 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:33.766000 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:33.774833 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.775334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.775767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.776546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.776952 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.777377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.912324 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.921065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.922599 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.923851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-441c8990-aecb-4d1f-bf95-4acae0e5905e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.162419 Oct 04 08:55:33.924400 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 450/920] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:33 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:34.949822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:34.950354 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:34.957196 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:34.957678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:34.958140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:34.958833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:34.959317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:34.959740 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.095132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.106191 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.108653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.109914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-befe4953-fa79-4d87-9936-b901bfea9f0a tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.164068 Oct 04 08:55:35.110482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 471/921] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:34 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:36.136426 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:36.137040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:36.144116 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.144596 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.145036 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.145755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.146212 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.146642 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.287716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.295927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.297354 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.299180 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-eceb5398-2acc-4f4d-ba8f-250faa89dcb3 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.166112 Oct 04 08:55:36.299731 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 451/922] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:36 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:37.326535 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:37.327111 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:37.333854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.334365 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.334799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:37.335585 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.336047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.336480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:37.472913 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:37.481802 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:37.483300 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:37.484486 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-49ef0fe2-79e9-457c-bd3b-cb8bde032fa4 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.162626 Oct 04 08:55:37.485049 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 472/923] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:37 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:38.510876 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:38.511484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:38.517850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.518325 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.518753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.519432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.519875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.520292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.701469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.710331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.711765 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.712905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8ab8706b-b56b-4b27-adfd-959b240cc245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.206008 Oct 04 08:55:38.713444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 452/924] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:38 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:39.739632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:39.740253 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:39.746804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.747291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.747731 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.748421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.748873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.749299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.926185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.934140 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.935574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.936719 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-551acfcb-66c5-4006-affd-8cb14e52a56f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.201668 Oct 04 08:55:39.937265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 473/925] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:39 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:40.962910 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:40.963480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:40.969828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.970313 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.970746 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:40.971436 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.971893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.972319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.101371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.109422 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.110949 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.112142 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-eba77899-567c-4c9d-bcd5-be3f78115312 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.153626 Oct 04 08:55:41.112693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 453/926] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:40 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:42.137213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:42.137900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:42.144629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.145109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.145543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.146254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.146732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.147153 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.277772 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.286441 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.287900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.289083 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-01c20b5e-8e6b-4873-9fd9-1293af875245 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.155769 Oct 04 08:55:42.289646 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 474/927] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:42 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:43.314297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:43.314942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:43.320885 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.321365 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.321829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.322516 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.322965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.323385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.448232 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:43.450471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:43.458150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:43.459582 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:43.460770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d7a77202-4e93-48c6-9877-7f82a9d021d6 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.150532 Oct 04 08:55:43.461318 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 454/928] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:43 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:44.487081 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:44.487692 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:44.493908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:44.494394 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:44.494829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.495630 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:44.496147 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:44.496777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.628648 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.636622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.638100 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.639266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-976d8796-bb6d-4f87-9767-454b23427347 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.156745 Oct 04 08:55:44.639822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 475/929] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:44 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:45.666190 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:45.666818 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:45.674570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.675054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.675486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.676174 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.676621 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.677038 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.803744 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.811717 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.813153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.814881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-37b03c77-5979-4cd8-be06-dc1c81b4f277 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.153221 Oct 04 08:55:45.815436 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 455/930] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:45 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:46.840936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:46.841541 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:46.847970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.848448 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.848877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.849556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.850027 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.850453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.977525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.985999 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.987442 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.988618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4208b272-11ff-4d26-bc0a-fdc6a399d888 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.151569 Oct 04 08:55:46.989173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 476/931] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:46 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:47.841753 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-74a19c22-779c-47f1-9356-6ba2f754da24 req-9242d782-1446-4242-a81b-912a81489be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4079470a-d577-4b42-810b-e864cdd7754a", "name": "network-vif-plugged", "status": "completed", "tag": "a483e39a-a337-488b-8e99-afe48bd9970b"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:47.852278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-74a19c22-779c-47f1-9356-6ba2f754da24 req-9242d782-1446-4242-a81b-912a81489be1 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.852759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-74a19c22-779c-47f1-9356-6ba2f754da24 req-9242d782-1446-4242-a81b-912a81489be1 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.853187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-74a19c22-779c-47f1-9356-6ba2f754da24 req-9242d782-1446-4242-a81b-912a81489be1 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.864579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-74a19c22-779c-47f1-9356-6ba2f754da24 req-9242d782-1446-4242-a81b-912a81489be1 service nova] Creating event network-vif-plugged:a483e39a-a337-488b-8e99-afe48bd9970b for instance 4079470a-d577-4b42-810b-e864cdd7754a on hv-cinder-86021 Oct 04 08:55:47.869674 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-74a19c22-779c-47f1-9356-6ba2f754da24 req-9242d782-1446-4242-a81b-912a81489be1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031679 Oct 04 08:55:47.870227 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 456/932] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:48.014369 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:48.014965 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:48.021511 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.022255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.022787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.023580 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.024065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.024639 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.216096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:48.224194 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:48.225725 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:48.226922 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-856c34bc-e61e-44e1-8c45-0ea217832031 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.216547 Oct 04 08:55:48.227471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 477/933] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:48 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:49.254164 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:49.254872 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:49.260996 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:49.261474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:49.261941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:49.262635 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:49.263108 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:49.263507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:49.394177 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.402190 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.403637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.404801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-596f49d3-dfaa-4d78-8050-77419a4b56c5 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.156121 Oct 04 08:55:49.405349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 457/934] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:49 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:50.430233 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:50.430895 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:50.437538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.438660 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.438993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.439699 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.440146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.440552 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.650031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.661982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.663704 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.665615 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e80a22af-b238-41e2-8c9f-ac95b5193aaa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1729 microversion: 2.20 time: 0.239403 Oct 04 08:55:50.666897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 478/935] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:50 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:51.691847 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:51.692453 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:51.698987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.699463 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.699892 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.700577 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.701029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.701448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.830544 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.838705 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.840133 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.841280 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a886691c-5aeb-403d-85d7-3e3cab9781fa tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1716 microversion: 2.20 time: 0.153383 Oct 04 08:55:51.841856 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 458/936] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:51 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:20.625257 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:20.625853 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:20.627949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=21 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:20.628672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:20.635506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.635991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.636435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.637128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.637582 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.638035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.662682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d42f14e0-3987-4311-b8a2-cce2d525eed1 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/ips" status: 200 len: 150 microversion: 2.1 time: 0.041949 Oct 04 08:56:20.663263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 479/937] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:56:20 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:21.989412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "438606d9-18aa-4e7a-af96-257ab22166e4"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:21.991815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.994215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 08:56:21.994358 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Tue Oct 4 08:56:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments (ip 10.222.0.26) !!! Oct 04 08:56:21.995660 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=21 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:21.996417 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=21 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:22.006853 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.007337 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.007771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.008458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.008903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.009322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.293888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0c665c18-3eb5-482d-bc74-cff14d293e29 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "POST /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308384 Oct 04 08:56:22.294543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 459/938] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:56:21 2022] POST /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:27.944329 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-53177050", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-322513154", "security_groups": [{"name": "tempest-secgroup-smoke-1244527694"}], "block_device_mapping_v2": [{"uuid": "d968f2f3-9f72-4289-aba6-8c1ae43ee637", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c006435c-ff61-43c2-8f47-dde46c8ddc02"}]}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:28.057903 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] validate_networks() for [('c006435c-ff61-43c2-8f47-dde46c8ddc02', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:56:28.470625 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:56:28.471052 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:56:28.471527 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:56:28.471935 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:56:28.472348 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:56:28.481071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.481551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.482011 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.482762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.483214 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.483637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.499957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:56:28.504474 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Getting quotas for user f928852d90b94ac5979e4a7806896b7a and project 1104ee1508e24a2b87820a8b0fafd0e1. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:56:28.560654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:56:28.563338 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d968f2f3-9f72-4289-aba6-8c1ae43ee637',volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:56:28.691025 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-62c5b91a-5ec0-4b88-954a-73d8d1f4cf3f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750494 Oct 04 08:56:28.691674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 480/939] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:56:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:56:28.704474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-54df837f-f6ae-4b91-8125-5d9aefb83946 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:28.705198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-54df837f-f6ae-4b91-8125-5d9aefb83946 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.758778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-54df837f-f6ae-4b91-8125-5d9aefb83946 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.765622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-54df837f-f6ae-4b91-8125-5d9aefb83946 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1092 microversion: 2.1 time: 0.066607 Oct 04 08:56:28.767189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 460/940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:28 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:29.789459 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:29.790097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:29.796133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.796619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.797059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.797814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.798276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.798704 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.864540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.872356 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f1a2c026-237c-4c19-b45f-97bbfda88b04 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1190 microversion: 2.1 time: 0.087215 Oct 04 08:56:29.873042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 481/941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:29 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:30.896570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:30.897112 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:30.904701 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.905191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.905627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.906352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.907427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.907831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.041942 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:31.050296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d3a81bbf-76ef-40d0-8cdb-fd36c822a207 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1276 microversion: 2.1 time: 0.157746 Oct 04 08:56:31.050859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 461/942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:30 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:31.459321 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-1126dcd0-038b-4b42-b5a5-cce1c397c035 req-43b3e357-516d-4320-9ab0-00a139d437e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b563fa-625b-4039-9c45-60a47f917213", "tag": "441ff4e6-5e52-45de-9c56-3a4ad0191457"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:31.468736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-1126dcd0-038b-4b42-b5a5-cce1c397c035 req-43b3e357-516d-4320-9ab0-00a139d437e7 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.469747 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-1126dcd0-038b-4b42-b5a5-cce1c397c035 req-43b3e357-516d-4320-9ab0-00a139d437e7 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.470188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-1126dcd0-038b-4b42-b5a5-cce1c397c035 req-43b3e357-516d-4320-9ab0-00a139d437e7 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.481014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-1126dcd0-038b-4b42-b5a5-cce1c397c035 req-43b3e357-516d-4320-9ab0-00a139d437e7 service nova] Creating event network-changed:441ff4e6-5e52-45de-9c56-3a4ad0191457 for instance 86b563fa-625b-4039-9c45-60a47f917213 on hv-cinder-86021 Oct 04 08:56:31.487020 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-1126dcd0-038b-4b42-b5a5-cce1c397c035 req-43b3e357-516d-4320-9ab0-00a139d437e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104425 Oct 04 08:56:31.487637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 482/943] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:32.073915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:32.074475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:32.085073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:32.086392 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:32.087037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:32.087769 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:32.088259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:32.088706 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:32.232698 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.240927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b68886a7-12fc-41ec-8658-9991777f30c1 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1276 microversion: 2.1 time: 0.171071 Oct 04 08:56:32.241485 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 462/944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:32 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:33.264381 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.265067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:33.271840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.272319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.272745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.273424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.273899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.274319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.413058 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:33.422257 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ccacd89c-8838-41ed-b7d4-de857e876ed3 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1276 microversion: 2.1 time: 0.162351 Oct 04 08:56:33.424472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 483/945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:33 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:34.185129 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:34.185801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:34.192467 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.193053 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.193523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.194349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.195055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.195619 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.281452 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'services' on Instance uuid f68fb3f4-71f4-4682-9688-f6e821feef01 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:34.357437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f9e1c222-b0f8-4ac4-927b-e9857a2c858d tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments/438606d9-18aa-4e7a-af96-257ab22166e4" status: 202 len: 0 microversion: 2.1 time: 0.176870 Oct 04 08:56:34.358265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 463/946] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 08:56:34 2022] DELETE /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments/438606d9-18aa-4e7a-af96-257ab22166e4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:34.367032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:34.369302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:34.376000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.376531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.377025 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.377795 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.378278 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.378705 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.409987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f543c2ad-6391-432d-82d1-b52fb8cf04f7 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 Oct 04 08:56:34.410539 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 484/947] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:34 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:34.446540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:34.447150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:34.453409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.453934 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.454412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.455895 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.456351 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.456778 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.588788 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:34.597056 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8786ed6d-fd2a-42a4-a632-233820a054e5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.154998 Oct 04 08:56:34.597614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 464/948] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:34 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:35.422735 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:35.424928 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:35.431297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.431782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.432216 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.432936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.433386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.433837 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.464444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-82637746-30fb-42a2-9cb9-45225fc17f57 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Oct 04 08:56:35.465008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 485/949] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:35 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:35.619706 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:35.620318 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:35.627117 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.627600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.628035 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.628724 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.629177 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.629606 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.758200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:35.765841 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f5d84ee0-17a5-4b1c-ab18-2bc4a026c564 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.149880 Oct 04 08:56:35.766401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 465/950] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:35 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:36.476746 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:36.478962 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:36.485490 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.486606 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.487042 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.487747 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.488198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.488622 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.518448 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0637aa02-aadf-4038-993c-9ecc756a0b05 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045600 Oct 04 08:56:36.519007 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 486/951] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:36 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:56:36.583249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:36.583854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:36.589591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.590114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.590528 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.591205 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.591681 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.592095 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.617450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:56:36.690722 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8c17fa0d-6317-4dc0-b00f-2c04fc770157 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 204 len: 0 microversion: 2.1 time: 0.111282 Oct 04 08:56:36.691583 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 466/952] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:36 2022] DELETE /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:56:36.699551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:36.700167 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:36.706808 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.707284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.707715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.708391 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.708837 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.709255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.790511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:36.791231 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:36.797157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.797645 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.798127 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.798846 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.799348 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.799773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.836217 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:36.844335 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5fdb5ffb-225a-43b3-8819-4b4a53cb5681 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1682 microversion: 2.1 time: 0.148580 Oct 04 08:56:36.844911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 487/953] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:36 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:36.930546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:36.938191 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6396a0d1-dfd6-412d-ab7b-20237dd2f367 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.152178 Oct 04 08:56:36.938754 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 467/954] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:36 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:37.868485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:37.869105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:37.875515 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.876056 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.877063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.877784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.878241 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.878669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.961408 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:37.962056 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:37.968415 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.968904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.969345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.970070 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.970530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.970963 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.010209 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.018542 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7a712d94-3491-4926-acf8-ae9e060aa9fc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1682 microversion: 2.1 time: 0.154025 Oct 04 08:56:38.019121 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 488/955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:37 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:38.099082 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.106682 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4ba9415e-be87-4430-8f0e-2a9a126a31a4 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.149306 Oct 04 08:56:38.107244 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 468/956] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:37 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:39.041684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:39.042323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:39.044255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:39.045043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:39.052044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.052538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.052970 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.053666 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.054147 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.054571 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.130168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:39.130788 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:39.132758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:39.138815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.139306 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.139742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.140469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.140925 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.141349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.277032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.278306 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.287118 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b339b61e-426c-4762-9018-9f6a907ab15a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.161393 Oct 04 08:56:39.287445 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-79ffb976-7d72-4517-97a0-8e00409ec30f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1682 microversion: 2.1 time: 0.249636 Oct 04 08:56:39.287960 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 469/957] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:39 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:39.290046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 489/958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:39 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:39.887075 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-1b1ff374-2f31-469a-aade-d1da0ad8c14b req-0db9688d-426d-45cb-be76-e7f08a315a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68fb3f4-71f4-4682-9688-f6e821feef01", "name": "network-vif-deleted", "tag": "0f0bdbdb-f916-4e99-9b5d-4646d71679d7"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:39.901829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-1b1ff374-2f31-469a-aade-d1da0ad8c14b req-0db9688d-426d-45cb-be76-e7f08a315a64 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.902409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-1b1ff374-2f31-469a-aade-d1da0ad8c14b req-0db9688d-426d-45cb-be76-e7f08a315a64 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.902908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-1b1ff374-2f31-469a-aade-d1da0ad8c14b req-0db9688d-426d-45cb-be76-e7f08a315a64 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.917986 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-1b1ff374-2f31-469a-aade-d1da0ad8c14b req-0db9688d-426d-45cb-be76-e7f08a315a64 service nova] Creating event network-vif-deleted:0f0bdbdb-f916-4e99-9b5d-4646d71679d7 for instance f68fb3f4-71f4-4682-9688-f6e821feef01 on hv-cinder-86021 Oct 04 08:56:39.926806 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-1b1ff374-2f31-469a-aade-d1da0ad8c14b req-0db9688d-426d-45cb-be76-e7f08a315a64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042729 Oct 04 08:56:39.928102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 470/959] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:40.311035 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:40.311593 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:40.312214 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:40.312845 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:40.320027 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.320222 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.320525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.320659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.320961 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.321223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.321699 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.322085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.322335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.322762 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.322871 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.323318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.356460 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.357050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.357566 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.358110 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'fault' on Instance uuid f68fb3f4-71f4-4682-9688-f6e821feef01 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:40.405717 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.413611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ea071882-1a7c-4e4d-ba5e-c0b9632f9699 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1331 microversion: 2.1 time: 0.106347 Oct 04 08:56:40.414222 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 471/960] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:40 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:40.464876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.472521 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3a1670e5-7d06-4d9d-9263-0ae5fd1ed40b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.165494 Oct 04 08:56:40.473092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 490/961] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:40 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:41.437440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.438081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.445045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.445524 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.445991 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.446680 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.447133 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.447555 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.479444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.479922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.480351 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.480793 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lazy-loading 'fault' on Instance uuid f68fb3f4-71f4-4682-9688-f6e821feef01 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:41.495132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.495742 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.502393 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.502943 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.504038 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.504789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.505240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.505670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.521079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0b7528b0ff4b09923a0e951d052ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd782f79ed84b81a998ae437af2a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:41.524710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:41.530090 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-48af8670-260a-47d0-a0c6-5afa6167e6e8 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 200 len: 1331 microversion: 2.1 time: 0.096466 Oct 04 08:56:41.530658 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 472/962] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:41 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:41.633891 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:41.641495 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-06346184-f608-42d8-8a80-0c6cd91b3a8c tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.150200 Oct 04 08:56:41.642097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 491/963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:41 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:42.552359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:42.552977 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:42.560674 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.561156 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.561586 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.562296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.562749 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.563167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.577429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 HTTP/1.1 Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:56:42.579073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:42.581088 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'f68fb3f4-71f4-4682-9688-f6e821feef01'} Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:42.582863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:42.584571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:42.586169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:42.586169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d3980fe3-7174-4b0f-87a1-44337bebe24c tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 404 len: 111 microversion: 2.1 time: 0.031995 Oct 04 08:56:42.586169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 473/964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:42 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:42.590418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0f838a35-b968-49b0-938a-d69f987ac56f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '.version_select at 0x7f5fd440f430>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:42.608177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0f838a35-b968-49b0-938a-d69f987ac56f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250082675" status: 202 len: 0 microversion: 2.1 time: 0.021729 Oct 04 08:56:42.608736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 492/965] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 08:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250082675 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:42.664458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:42.665064 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:42.671140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.671614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.672042 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.672728 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.673172 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.673588 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.810551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.819036 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-242d58a4-9e45-4626-8f3d-c12ca88cdb7f tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.158390 Oct 04 08:56:42.819609 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 474/966] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:42 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:43.842080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:43.842700 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:43.849506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.850030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.850470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.851164 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.851620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.852044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.984314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.992917 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-534a88cf-365d-4766-a076-e0c20ba5ac7b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.154752 Oct 04 08:56:43.993485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 493/967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:43 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:44.354132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:44.354773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:44.361055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.361536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.361998 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.362709 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.363159 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.363580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.376661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: DELETE /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 HTTP/1.1 Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:56:44.378271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.379918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'f68fb3f4-71f4-4682-9688-f6e821feef01'} Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:44.380873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.382491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.384165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:44.384165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-950a21bc-d79e-4a31-906b-49199f3188ed tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 404 len: 111 microversion: 2.1 time: 0.029355 Oct 04 08:56:44.384165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 475/968] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:44 2022] DELETE /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:44.389316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:44.389874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: f68fb3f4-71f4-4682-9688-f6e821feef01] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:44.396586 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.397071 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.397497 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.398210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.398654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.399073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.412930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 HTTP/1.1 Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:56:44.414581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.416243 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'f68fb3f4-71f4-4682-9688-f6e821feef01'} Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:44.417240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. Oct 04 08:56:44.418793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:44.420255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance f68fb3f4-71f4-4682-9688-f6e821feef01 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:44.420255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f5fedcd0-6f8c-4ec3-b068-06558c1493df tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01" status: 404 len: 111 microversion: 2.1 time: 0.030872 Oct 04 08:56:44.420255 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 494/969] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:44 2022] GET /compute/v2.1/servers/f68fb3f4-71f4-4682-9688-f6e821feef01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:45.015410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.016025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.021988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.022481 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.022921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.023612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.024067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.024493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.154505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.162143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-feb28550-74ba-4d79-95fd-b6dde11328c2 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.150524 Oct 04 08:56:45.162690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 476/970] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:45.551366 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.551857 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.558172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.558650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.559087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.559765 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.560215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.560633 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.573721 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 HTTP/1.1 Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:56:45.575237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.576856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '4e8d2b2f-7930-42d6-b6d3-5f7a282bd723'} Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:45.577672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.579039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.580360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:45.580360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c538310e-9899-4f39-a0d7-57c9db830aaf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 404 len: 111 microversion: 2.1 time: 0.029657 Oct 04 08:56:45.580360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 495/971] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:45 2022] DELETE /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:45.585092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.585759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.592076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.592556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.593046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.593761 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.594215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.594637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.608150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 HTTP/1.1 Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:56:45.609653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.611308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '4e8d2b2f-7930-42d6-b6d3-5f7a282bd723'} Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:45.612219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. Oct 04 08:56:45.614327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.615693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance 4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:45.615693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4c8639a4-93da-4af0-b784-93106a6e0c93 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723" status: 404 len: 111 microversion: 2.1 time: 0.030045 Oct 04 08:56:45.615693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 477/972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/4e8d2b2f-7930-42d6-b6d3-5f7a282bd723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:45.620070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.620579 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.626615 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.627095 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.627531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.628216 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.628669 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.629096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.642163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e HTTP/1.1 Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:56:45.643679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.645275 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'b39d3753-4068-45e1-bf8c-1e7b4002137e'} Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:45.646198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.647682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.649605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:45.649605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-883f3a72-2b87-4881-b02d-5802cb1edcbf tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 404 len: 111 microversion: 2.1 time: 0.028848 Oct 04 08:56:45.649605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 496/973] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:45 2022] DELETE /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:45.653083 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.653717 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: b39d3753-4068-45e1-bf8c-1e7b4002137e] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.660167 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.660650 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.661085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.661803 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.662260 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.662686 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.676562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e HTTP/1.1 Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:56:45.678104 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.680525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'b39d3753-4068-45e1-bf8c-1e7b4002137e'} Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:45.681858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. Oct 04 08:56:45.684183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:45.686065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance b39d3753-4068-45e1-bf8c-1e7b4002137e could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:45.686065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-88a20d77-8059-4866-b796-23aa23a86220 tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e" status: 404 len: 111 microversion: 2.1 time: 0.030195 Oct 04 08:56:45.686065 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 478/974] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/b39d3753-4068-45e1-bf8c-1e7b4002137e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:46.137007 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-92967d4d-d80d-4e70-b8bb-87e0860e9b73 req-610fd73a-d83a-496c-a0b5-f78e64194bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b563fa-625b-4039-9c45-60a47f917213", "name": "network-vif-plugged", "status": "completed", "tag": "441ff4e6-5e52-45de-9c56-3a4ad0191457"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:46.146605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-92967d4d-d80d-4e70-b8bb-87e0860e9b73 req-610fd73a-d83a-496c-a0b5-f78e64194bef service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.147088 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-92967d4d-d80d-4e70-b8bb-87e0860e9b73 req-610fd73a-d83a-496c-a0b5-f78e64194bef service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.147522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-92967d4d-d80d-4e70-b8bb-87e0860e9b73 req-610fd73a-d83a-496c-a0b5-f78e64194bef service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.161538 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-92967d4d-d80d-4e70-b8bb-87e0860e9b73 req-610fd73a-d83a-496c-a0b5-f78e64194bef service nova] Creating event network-vif-plugged:441ff4e6-5e52-45de-9c56-3a4ad0191457 for instance 86b563fa-625b-4039-9c45-60a47f917213 on hv-cinder-86021 Oct 04 08:56:46.166537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-92967d4d-d80d-4e70-b8bb-87e0860e9b73 req-610fd73a-d83a-496c-a0b5-f78e64194bef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089800 Oct 04 08:56:46.167122 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 497/975] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:46.184343 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.185253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.191516 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.192027 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.192475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.193185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.193663 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.194137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.329508 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.337584 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-82744543-e200-41dc-a90d-14fda0ea0c96 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.157143 Oct 04 08:56:46.338208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 479/976] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:46.818166 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.818761 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.824804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.825287 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.825755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.826450 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.826906 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.827333 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.841321 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f HTTP/1.1 Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:56:46.842991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.844608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '7b03cac8-950a-405e-b19b-90a962f5c73f'} Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:46.845534 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.847132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.848932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:46.848932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f973fe47-8b29-42ca-bb13-5c242a0664cc tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 404 len: 111 microversion: 2.1 time: 0.031544 Oct 04 08:56:46.848932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 498/977] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:46 2022] DELETE /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:46.852661 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.853274 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] [instance: 7b03cac8-950a-405e-b19b-90a962f5c73f] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.859767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.860249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.860687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.861380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.861865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.862294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.875230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] HTTP exception thrown: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Request method failure captured: Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f HTTP/1.1 Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_LCKxJzmYRlbJIENGvjGzcObBfd_7kCCmaCROm_hIhUgfpwqcj1ebrwV77VIbsrHAcews8cN6ThpCuAKfaYGSLVU_fGmxR_Avv4L_Ws_UVFUza_cpAbgUGo_MxLB2FjLTxnJPCEubXHjariDft7HQLVJJQGE6u19jP1EMo-986a4-Q Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:56:46.876739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bd782f79ed84b81a998ae437af2a6cb"}]}] Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 9bd782f79ed84b81a998ae437af2a6cb Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470922058 Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 3c0b7528b0ff4b09923a0e951d052ed5 Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeNegativeTest-470922058-project Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.878924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '7b03cac8-950a-405e-b19b-90a962f5c73f'} Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:46.879855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. Oct 04 08:56:46.881371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:56:46.882745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] Returning 404 to user: Instance 7b03cac8-950a-405e-b19b-90a962f5c73f could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:46.882745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f5c34395-12aa-4bda-b2bb-48192f9b4f7f tempest-AttachVolumeNegativeTest-470922058 tempest-AttachVolumeNegativeTest-470922058-project] 10.222.0.26 "GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f" status: 404 len: 111 microversion: 2.1 time: 0.029268 Oct 04 08:56:46.882745 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 480/978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/7b03cac8-950a-405e-b19b-90a962f5c73f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:56:47.360358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:47.360921 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.367236 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.367722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.368157 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.368850 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.369302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.369752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.501632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.510094 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a0a9a841-9c8a-49b5-a04e-139bad181880 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1264 microversion: 2.1 time: 0.153742 Oct 04 08:56:47.510656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 499/979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:47 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:48.537471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:48.539380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:48.546393 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.548079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.548688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.549424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.550102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.551260 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.849674 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:48.858702 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-63992cce-c414-4b37-ab54-9822b485d758 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1451 microversion: 2.1 time: 0.325654 Oct 04 08:56:48.859438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 481/980] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:48 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1451 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:48.882005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:48.882752 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:48.890218 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.890813 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.891320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.892101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.892654 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.893146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:49.040453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.048619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-20b5a6f2-859d-43f0-8695-5008aef736d7 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1451 microversion: 2.1 time: 0.170777 Oct 04 08:56:49.049725 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 500/981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:48 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:51.131118 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-78832b25-8550-47ed-85d8-73f9f7460e7d req-8e203f07-5373-4457-b56c-92721c695d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b563fa-625b-4039-9c45-60a47f917213", "tag": "441ff4e6-5e52-45de-9c56-3a4ad0191457"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:51.147020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-78832b25-8550-47ed-85d8-73f9f7460e7d req-8e203f07-5373-4457-b56c-92721c695d44 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.147439 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-78832b25-8550-47ed-85d8-73f9f7460e7d req-8e203f07-5373-4457-b56c-92721c695d44 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.147876 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-78832b25-8550-47ed-85d8-73f9f7460e7d req-8e203f07-5373-4457-b56c-92721c695d44 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.159367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-78832b25-8550-47ed-85d8-73f9f7460e7d req-8e203f07-5373-4457-b56c-92721c695d44 service nova] Creating event network-changed:441ff4e6-5e52-45de-9c56-3a4ad0191457 for instance 86b563fa-625b-4039-9c45-60a47f917213 on hv-cinder-86021 Oct 04 08:56:51.165049 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-78832b25-8550-47ed-85d8-73f9f7460e7d req-8e203f07-5373-4457-b56c-92721c695d44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037526 Oct 04 08:56:51.165783 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 482/982] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:52.867230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0a7dc376-296e-42e4-abae-efab9dec2027 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd4304af0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.914465 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0a7dc376-296e-42e4-abae-efab9dec2027 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/380030c3-9bb3-42fe-aee9-52767841707a" status: 200 len: 350 microversion: 2.1 time: 0.050992 Oct 04 08:56:52.915063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 501/983] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/os-volumes/380030c3-9bb3-42fe-aee9-52767841707a => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:54.241656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-574d2206-debe-4d0b-9056-abc3c2a5fcfb tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd7b59670>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:54.287624 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-574d2206-debe-4d0b-9056-abc3c2a5fcfb tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/13488ec8-d5ea-4b79-b298-6d80471008ea" status: 200 len: 351 microversion: 2.1 time: 0.051368 Oct 04 08:56:54.288182 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 483/984] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:56:54 2022] GET /compute/v2.1/os-volumes/13488ec8-d5ea-4b79-b298-6d80471008ea => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:55.621237 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d7725bd1-e613-4887-8284-cbd8352a7bdb tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd42305e0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.670213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d7725bd1-e613-4887-8284-cbd8352a7bdb tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/7e4a0a6e-17f6-48d3-b72e-2358491f6631" status: 200 len: 351 microversion: 2.1 time: 0.053183 Oct 04 08:56:55.670853 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 502/985] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/os-volumes/7e4a0a6e-17f6-48d3-b72e-2358491f6631 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:55.684766 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a41ee6aa-8f95-4aea-9a69-598f4585ed52 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd7ae6550>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.773054 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a41ee6aa-8f95-4aea-9a69-598f4585ed52 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092500 Oct 04 08:56:55.773744 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 484/986] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:55.789524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e3fe4ec8-3489-4d18-8567-5f861d3dab40 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd41a39d0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.873428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e3fe4ec8-3489-4d18-8567-5f861d3dab40 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087634 Oct 04 08:56:55.874034 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 503/987] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:55.887464 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9b6a9d75-8446-45da-858b-af2e6c0ca75d tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd7ae0280>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.970474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9b6a9d75-8446-45da-858b-af2e6c0ca75d tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086665 Oct 04 08:56:55.971128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 485/988] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:55.984157 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-703fd7a1-3e69-4fe7-a373-dd6bbe5a7088 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd42faca0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.066363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-703fd7a1-3e69-4fe7-a373-dd6bbe5a7088 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085342 Oct 04 08:56:56.067017 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 504/989] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:56.080465 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fac37c5a-60c9-400c-8c15-67393d748cfa tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd7b400d0>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.162944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fac37c5a-60c9-400c-8c15-67393d748cfa tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086311 Oct 04 08:56:56.163520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 486/990] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:56.178804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-7580343e-202c-4c5a-82dc-b9f6b46fbfff tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd4279790>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.200246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.200869 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.202850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:56.208756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.209242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.209676 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.210579 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.211298 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.211724 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.239660 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:56:56.275185 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-7580343e-202c-4c5a-82dc-b9f6b46fbfff tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.101502 Oct 04 08:56:56.276523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 505/991] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:56.324908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7a19edcf-dbf1-4573-adc7-4d9b377df5a1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 204 len: 0 microversion: 2.1 time: 0.128299 Oct 04 08:56:56.325768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 487/992] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:56 2022] DELETE /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:56:56.330965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9b061cf8-1819-47fb-8316-2bcb2f3a0554 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd7b97280>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.421295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9b061cf8-1819-47fb-8316-2bcb2f3a0554 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094172 Oct 04 08:56:56.421886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 488/993] 10.222.0.26 () {58 vars in 1188 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:56.431133 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.431964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.439284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.439776 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.440210 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.440328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-d21fe918-8967-4b10-917e-6d0661edcafb req-1687d851-188f-43e4-9c83-2e2fde6cfe02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca2be3f-0f92-4726-a2cd-b4411b5a568d", "tag": "62e424ab-6247-49c9-940d-ec255b6199a8"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:56.441438 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.441918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.442525 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.447949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:56.452427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d21fe918-8967-4b10-917e-6d0661edcafb req-1687d851-188f-43e4-9c83-2e2fde6cfe02 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.453097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d21fe918-8967-4b10-917e-6d0661edcafb req-1687d851-188f-43e4-9c83-2e2fde6cfe02 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.453599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-d21fe918-8967-4b10-917e-6d0661edcafb req-1687d851-188f-43e4-9c83-2e2fde6cfe02 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.458631 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=97 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:56.466820 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-d21fe918-8967-4b10-917e-6d0661edcafb req-1687d851-188f-43e4-9c83-2e2fde6cfe02 service nova] Creating event network-changed:62e424ab-6247-49c9-940d-ec255b6199a8 for instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d on hv-cinder-86021 Oct 04 08:56:56.472777 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-d21fe918-8967-4b10-917e-6d0661edcafb req-1687d851-188f-43e4-9c83-2e2fde6cfe02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194929 Oct 04 08:56:56.473457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 506/994] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:56.479732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0ca0338c-e866-4488-a0b4-83b92b9af3b1 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] Calling method '.version_select at 0x7f5fd40d0160>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.572072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0ca0338c-e866-4488-a0b4-83b92b9af3b1 tempest-VolumesTestJSON-942436246 tempest-VolumesTestJSON-942436246-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097194 Oct 04 08:56:56.572641 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 507/995] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:56.585600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.593901 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4d6621e7-e28f-4b70-8add-b3b445374fd6 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.170910 Oct 04 08:56:56.595129 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 489/996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:57.618309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:57.619085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:57.625936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.626429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.626868 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.627561 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.628020 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.628449 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.774040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.784320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3cc7a5ad-e2eb-4510-9f1c-bdf1793adaa7 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.170438 Oct 04 08:56:57.784881 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 508/997] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:57 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:58.808055 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:58.808669 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:58.814985 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:58.815472 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:58.815908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:58.816592 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:58.817556 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:58.818007 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:58.955571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:58.965040 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-06877189-6962-4067-a20f-afcd651f06d5 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1568 microversion: 2.1 time: 0.160886 Oct 04 08:56:58.965989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 490/998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:58 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:59.592045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-b300af78-f624-4510-826e-62146f96c87d req-f2063c77-fb1a-4eaa-9da4-4066e223014a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2be3f-0f92-4726-a2cd-b4411b5a568d", "name": "network-vif-deleted", "tag": "62e424ab-6247-49c9-940d-ec255b6199a8"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:59.604023 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-b300af78-f624-4510-826e-62146f96c87d req-f2063c77-fb1a-4eaa-9da4-4066e223014a service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:59.604508 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-b300af78-f624-4510-826e-62146f96c87d req-f2063c77-fb1a-4eaa-9da4-4066e223014a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:59.604939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-b300af78-f624-4510-826e-62146f96c87d req-f2063c77-fb1a-4eaa-9da4-4066e223014a service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:59.618335 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-b300af78-f624-4510-826e-62146f96c87d req-f2063c77-fb1a-4eaa-9da4-4066e223014a service nova] Creating event network-vif-deleted:62e424ab-6247-49c9-940d-ec255b6199a8 for instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d on hv-cinder-86021 Oct 04 08:56:59.624525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-b300af78-f624-4510-826e-62146f96c87d req-f2063c77-fb1a-4eaa-9da4-4066e223014a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036317 Oct 04 08:56:59.625139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 509/999] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:56:59.991662 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:59.992520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:59.999978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:00.000470 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:00.000939 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:00.001593 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:00.002235 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:00.002817 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:00.078501 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe240ebc7c643358db4ae3a9ef132ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a75a59f42a74dee854ddc7b5f109143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:00.088079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d8e5f4fe-eb61-4243-8fe6-46981f73de4b tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 200 len: 1219 microversion: 2.1 time: 0.102625 Oct 04 08:57:00.089392 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 491/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:59 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:01.111675 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:01.112867 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] [instance: 2ca2be3f-0f92-4726-a2cd-b4411b5a568d] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:01.120110 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:01.120263 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:01.120637 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:01.121333 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:01.121811 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:01.122235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:01.136029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] HTTP exception thrown: Instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d could not be found. Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Request method failure captured: Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d HTTP/1.1 Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_PqS_-4G9J0iWFnFZi2bf3gvwLamozGUXZsLp4RF4bSQZp-qlhopLQPtt3Dr74eTuC9mCfs3-ShPsASrW-IlidI_AjzD7bdCtOurZXv4bXlCVNBCf86SqYv0Xiu-9mKuseUpY1t-I9Pqv3o5O6b_--Lm-hK13vVi6WIdpRXoETcdR0 Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 4a75a59f42a74dee854ddc7b5f109143 Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-TestShelveInstance-1695943118 Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:57:01.137655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a75a59f42a74dee854ddc7b5f109143"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a75a59f42a74dee854ddc7b5f109143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a75a59f42a74dee854ddc7b5f109143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a75a59f42a74dee854ddc7b5f109143"}]}] Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-TestShelveInstance-1695943118 Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 4a75a59f42a74dee854ddc7b5f109143 Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-TestShelveInstance-1695943118 Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-TestShelveInstance-1695943118-project Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: dfe240ebc7c643358db4ae3a9ef132ea Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-TestShelveInstance-1695943118-project Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d could not be found. Oct 04 08:57:01.139351 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '2ca2be3f-0f92-4726-a2cd-b4411b5a568d'} Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d could not be found. Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:01.140634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d could not be found. Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d could not be found. Oct 04 08:57:01.141972 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:01.143260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Returning 404 to user: Instance 2ca2be3f-0f92-4726-a2cd-b4411b5a568d could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:01.143260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ffcc5a39-996b-4d74-8b74-bc346396cca1 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d" status: 404 len: 111 microversion: 2.1 time: 0.032145 Oct 04 08:57:01.143260 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 510/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:01 2022] GET /compute/v2.1/servers/2ca2be3f-0f92-4726-a2cd-b4411b5a568d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:01.309197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-21d82f6b-e28e-4c05-80b3-65ee76b5e968 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] Calling method '.version_select at 0x7f5fd4300940>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:01.353062 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-21d82f6b-e28e-4c05-80b3-65ee76b5e968 tempest-TestShelveInstance-1695943118 tempest-TestShelveInstance-1695943118-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1491432777" status: 202 len: 0 microversion: 2.1 time: 0.050877 Oct 04 08:57:01.353626 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 492/1002] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 4 08:57:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1491432777 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:10.443168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:10.445293 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:10.451786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.452265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.452697 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.453370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.453844 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.454261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.489619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-84000df0-b152-4ea9-9a16-f4fc4519efdc tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050559 Oct 04 08:57:10.490132 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 511/1003] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 08:57:10 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:10.554530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:10.555070 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:10.557816 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:10.563802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.564289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.564748 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.565427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.565905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.566321 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.591777 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:10.668424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-490a5cb7-3260-40c5-9835-446d77c45386 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 204 len: 0 microversion: 2.20 time: 0.118248 Oct 04 08:57:10.669222 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 493/1004] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 08:57:10 2022] DELETE /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:57:10.679797 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:10.680482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:10.686415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.686897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.687327 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.688012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:10.688485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:10.688883 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:10.822992 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:10.831107 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:10.832833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:10.834073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cdfa4fa6-4000-44dc-9203-9acecd903781 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.160479 Oct 04 08:57:10.834627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 512/1005] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:10 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:57:11.860555 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:11.861270 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:11.867345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:11.867819 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:11.868247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:11.868926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:11.869371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:11.869822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:11.998726 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:12.007466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:12.008992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:12.010189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-97e923de-c704-4f07-988c-34132f5be82f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.154166 Oct 04 08:57:12.010767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 494/1006] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:11 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:13.036856 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:13.037462 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:13.043612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:13.044092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:13.044523 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:13.045203 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:13.045649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:13.046102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:13.246934 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:13.255082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:13.256515 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:13.257712 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5300cfbb-a4e8-44ca-9ec1-32a9b52e7add tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1722 microversion: 2.20 time: 0.225356 Oct 04 08:57:13.258264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 513/1007] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:13 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:13.979975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-280c88a0-3846-41ec-86ed-075f7a661f26 req-58ca79e3-6715-4757-9542-03b48aefd174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4079470a-d577-4b42-810b-e864cdd7754a", "name": "network-vif-deleted", "tag": "a483e39a-a337-488b-8e99-afe48bd9970b"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:13.994589 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-280c88a0-3846-41ec-86ed-075f7a661f26 req-58ca79e3-6715-4757-9542-03b48aefd174 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:13.995212 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-280c88a0-3846-41ec-86ed-075f7a661f26 req-58ca79e3-6715-4757-9542-03b48aefd174 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:13.995538 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-280c88a0-3846-41ec-86ed-075f7a661f26 req-58ca79e3-6715-4757-9542-03b48aefd174 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:14.014081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-280c88a0-3846-41ec-86ed-075f7a661f26 req-58ca79e3-6715-4757-9542-03b48aefd174 service nova] Creating event network-vif-deleted:a483e39a-a337-488b-8e99-afe48bd9970b for instance 4079470a-d577-4b42-810b-e864cdd7754a on hv-cinder-86021 Oct 04 08:57:14.020454 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-280c88a0-3846-41ec-86ed-075f7a661f26 req-58ca79e3-6715-4757-9542-03b48aefd174 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045129 Oct 04 08:57:14.021175 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 495/1008] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:14.284993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:14.286189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:14.300247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:14.318585 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:14.320784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:14.324688 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:14.325625 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:14.326259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:14.369727 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:14.370210 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:14.370653 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:14.371105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lazy-loading 'fault' on Instance uuid 4079470a-d577-4b42-810b-e864cdd7754a {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:14.418740 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:14.428102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:14.430008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed4b7bfb87b144b38b82514c17a468bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8dda1234f54905962e427bf75e82c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:14.431193 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d6f6bc7a-fda5-42f4-b8e5-6986d8fbf5b9 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 200 len: 1371 microversion: 2.20 time: 0.151241 Oct 04 08:57:14.433913 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 514/1009] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:14 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:15.459307 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:15.459983 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:15.466801 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:15.467278 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:15.467706 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:15.468397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:15.468844 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:15.469264 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:15.483326 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] HTTP exception thrown: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Request method failure captured: Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a HTTP/1.1 Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_K_pYhnbNSm1_EZGlfK5nGFQxWXNHby0LO4IclAtjWC4NM57WRHBr_0rU4dgFEQlxPD7GhSbhMMP2XHFLqsxH0aBeXsbKehdmD8yqy1e62KJ1q0omr6wj7cptaUz1VAHinZqIprco-rTrJsNblGle9559qEz4r3axreKaINTPU1rXE Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:57:15.485249 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}] Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: ed4b7bfb87b144b38b82514c17a468bc Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:15.487221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '4079470a-d577-4b42-810b-e864cdd7754a'} Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:15.489020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:15.490862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:15.492386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Returning 404 to user: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:15.492386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c7fcf716-b1eb-4b2c-8a5e-d463645ea4d8 tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 404 len: 111 microversion: 2.20 time: 0.032563 Oct 04 08:57:15.492386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 496/1010] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:15 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:57:15.496283 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-07ce558d-e095-4dfe-9177-e2e689b415ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '.version_select at 0x7f5fd4250430>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:15.514577 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-07ce558d-e095-4dfe-9177-e2e689b415ce tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649006294" status: 204 len: 0 microversion: 2.20 time: 0.022341 Oct 04 08:57:15.515150 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 515/1011] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 4 08:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649006294 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:57:17.310402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:17.311809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:17.323863 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.324415 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.325112 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.325880 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.326367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.327000 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.342466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] HTTP exception thrown: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Request method failure captured: Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: DELETE /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a HTTP/1.1 Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_K_pYhnbNSm1_EZGlfK5nGFQxWXNHby0LO4IclAtjWC4NM57WRHBr_0rU4dgFEQlxPD7GhSbhMMP2XHFLqsxH0aBeXsbKehdmD8yqy1e62KJ1q0omr6wj7cptaUz1VAHinZqIprco-rTrJsNblGle9559qEz4r3axreKaINTPU1rXE Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:57:17.344113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}] Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: ed4b7bfb87b144b38b82514c17a468bc Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.345927 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '4079470a-d577-4b42-810b-e864cdd7754a'} Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:17.347092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.349146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.351014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Returning 404 to user: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:17.351014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fe672d46-7c87-491e-96b5-d20d675f32cd tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 404 len: 111 microversion: 2.20 time: 0.041039 Oct 04 08:57:17.351014 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 497/1012] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 08:57:17 2022] DELETE /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 08:57:17.355678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:17.356299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: 4079470a-d577-4b42-810b-e864cdd7754a] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:17.363006 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.363499 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.364530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.365227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.365766 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.366152 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.379094 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] HTTP exception thrown: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Request method failure captured: Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a HTTP/1.1 Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_K_pYhnbNSm1_EZGlfK5nGFQxWXNHby0LO4IclAtjWC4NM57WRHBr_0rU4dgFEQlxPD7GhSbhMMP2XHFLqsxH0aBeXsbKehdmD8yqy1e62KJ1q0omr6wj7cptaUz1VAHinZqIprco-rTrJsNblGle9559qEz4r3axreKaINTPU1rXE Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:57:17.381187 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}] Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: ed4b7bfb87b144b38b82514c17a468bc Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.383030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '4079470a-d577-4b42-810b-e864cdd7754a'} Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:17.387524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. Oct 04 08:57:17.389658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:17.391276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Returning 404 to user: Instance 4079470a-d577-4b42-810b-e864cdd7754a could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:17.391276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d597e13d-2c93-43bc-b285-67ed5c4b9fed tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a" status: 404 len: 111 microversion: 2.20 time: 0.031480 Oct 04 08:57:17.391276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 516/1013] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:17 2022] GET /compute/v2.1/servers/4079470a-d577-4b42-810b-e864cdd7754a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:57:18.526092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:18.526573 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:18.533184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:18.533671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:18.534179 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:18.534938 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:18.535510 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:18.535852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:18.549320 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] HTTP exception thrown: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Request method failure captured: Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: DELETE /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 HTTP/1.1 Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_K_pYhnbNSm1_EZGlfK5nGFQxWXNHby0LO4IclAtjWC4NM57WRHBr_0rU4dgFEQlxPD7GhSbhMMP2XHFLqsxH0aBeXsbKehdmD8yqy1e62KJ1q0omr6wj7cptaUz1VAHinZqIprco-rTrJsNblGle9559qEz4r3axreKaINTPU1rXE Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:57:18.550968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}] Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: ed4b7bfb87b144b38b82514c17a468bc Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.553187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'd2c490e2-0104-4fcb-b255-1f1c8b41c083'} Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:18.554128 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.555688 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.557202 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Returning 404 to user: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:18.557202 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-286ca0e8-797a-478a-b886-b5fbebe07a8e tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 404 len: 111 microversion: 2.20 time: 0.030595 Oct 04 08:57:18.557202 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 498/1014] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 08:57:18 2022] DELETE /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:57:18.561242 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:18.561922 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] [instance: d2c490e2-0104-4fcb-b255-1f1c8b41c083] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:18.568832 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:18.569316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:18.569790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:18.570487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:18.570994 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:18.571420 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:18.585001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] HTTP exception thrown: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Request method failure captured: Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 HTTP/1.1 Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_K_pYhnbNSm1_EZGlfK5nGFQxWXNHby0LO4IclAtjWC4NM57WRHBr_0rU4dgFEQlxPD7GhSbhMMP2XHFLqsxH0aBeXsbKehdmD8yqy1e62KJ1q0omr6wj7cptaUz1VAHinZqIprco-rTrJsNblGle9559qEz4r3axreKaINTPU1rXE Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:57:18.586558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ed8dda1234f54905962e427bf75e82c1"}]}] Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: ed8dda1234f54905962e427bf75e82c1 Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1183902145 Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: ed4b7bfb87b144b38b82514c17a468bc Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1183902145-project Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.588322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'd2c490e2-0104-4fcb-b255-1f1c8b41c083'} Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:18.589261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. Oct 04 08:57:18.590779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:57:18.592169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] Returning 404 to user: Instance d2c490e2-0104-4fcb-b255-1f1c8b41c083 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:18.592169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-40d12b4d-f67e-47ba-9d5f-318e8930dc2f tempest-AttachVolumeShelveTestJSON-1183902145 tempest-AttachVolumeShelveTestJSON-1183902145-project] 10.222.0.26 "GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083" status: 404 len: 111 microversion: 2.20 time: 0.030551 Oct 04 08:57:18.592169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 517/1015] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:18 2022] GET /compute/v2.1/servers/d2c490e2-0104-4fcb-b255-1f1c8b41c083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:57:27.355270 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c8f6d2b4-8fab-4551-87e9-a0c2b1370c8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'create', calling method: .version_select at 0x7f5fd4300310>, body: {"keypair": {"name": "tempest-keypair-837547927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGV+33jeFXX7dKdcL67v+UaRzq2ojVEe//Q+TfgOyTd3zPj/rHwjtexx2/vQT3+1YOqvC+Ux3SynM/JNkcrfaTff2eDYvILQoeySFI7DyCwpnFDObFVdVx37WtfwzJWXA=="}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:27.360741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:27.374263 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-c8f6d2b4-8fab-4551-87e9-a0c2b1370c8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for project 4370b750fe184c5eade1378abfa02752. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:57:27.378355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-c8f6d2b4-8fab-4551-87e9-a0c2b1370c8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for user c710350e02634e84b3d4700ae5fa6925 and project 4370b750fe184c5eade1378abfa02752. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:57:27.407696 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c8f6d2b4-8fab-4551-87e9-a0c2b1370c8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.222839 Oct 04 08:57:27.408812 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 499/1016] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 08:57:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:29.021282 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-266805670", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cee735a-1c65-4161-98c7-3d57900a3b66"}], "security_groups": [{"name": "tempest-securitygroup--1581807295"}], "key_name": "tempest-keypair-837547927", "user_data": "}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:29.031395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:29.032172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=41 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:29.146924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] validate_networks() for [('5cee735a-1c65-4161-98c7-3d57900a3b66', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:57:29.557019 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:57:29.557726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:57:29.558437 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:57:29.559016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:57:29.559600 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:57:29.570575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:29.571419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:29.572264 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:29.573368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:29.574141 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:29.574900 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:29.596927 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for project 4370b750fe184c5eade1378abfa02752. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:57:29.602251 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for user c710350e02634e84b3d4700ae5fa6925 and project 4370b750fe184c5eade1378abfa02752. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:57:29.615894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:57:29.618344 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:57:29.677980 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e4d8a117-b3d4-4b8a-9205-67ecf3499fdf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661232 Oct 04 08:57:29.678638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 518/1017] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 08:57:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:57:29.687471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:29.692387 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2600ba62-88a0-4996-a1ba-13b0441baebd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:29.693103 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2600ba62-88a0-4996-a1ba-13b0441baebd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:29.761215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2600ba62-88a0-4996-a1ba-13b0441baebd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:29.770288 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2600ba62-88a0-4996-a1ba-13b0441baebd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1236 microversion: 2.1 time: 0.083862 Oct 04 08:57:29.771058 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 500/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:29 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:30.797400 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:30.798160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:30.806908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:30.807412 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:30.807890 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:30.808908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:30.810177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:30.810627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:30.893154 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:30.903233 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-35a52291-7ddc-4f48-ab32-25a42e9f47e4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1288 microversion: 2.1 time: 0.111252 Oct 04 08:57:30.904289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 519/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:30 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1288 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:31.927046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:31.927602 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:31.935469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:31.936238 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:31.937003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:31.939728 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:31.940428 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:31.941102 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:32.087328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:32.094990 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2da71546-0c3e-40b6-ad65-d70e2150c05d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.172376 Oct 04 08:57:32.095559 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 501/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:31 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:32.681894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-5c979edc-881b-42a9-b7a8-02ee42be68c9 req-87d5c934-df1a-4647-b9b5-05d5b317176e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e8c036-5f98-4049-8672-6345ca8497d9", "tag": "2e14b84c-0e13-4974-a9f9-6249502dcba3"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:32.693424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5c979edc-881b-42a9-b7a8-02ee42be68c9 req-87d5c934-df1a-4647-b9b5-05d5b317176e service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:32.694225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5c979edc-881b-42a9-b7a8-02ee42be68c9 req-87d5c934-df1a-4647-b9b5-05d5b317176e service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:32.694939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-5c979edc-881b-42a9-b7a8-02ee42be68c9 req-87d5c934-df1a-4647-b9b5-05d5b317176e service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:32.706789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-5c979edc-881b-42a9-b7a8-02ee42be68c9 req-87d5c934-df1a-4647-b9b5-05d5b317176e service nova] Creating event network-changed:2e14b84c-0e13-4974-a9f9-6249502dcba3 for instance a6e8c036-5f98-4049-8672-6345ca8497d9 on hv-cinder-86021 Oct 04 08:57:32.712524 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-5c979edc-881b-42a9-b7a8-02ee42be68c9 req-87d5c934-df1a-4647-b9b5-05d5b317176e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034816 Oct 04 08:57:32.713370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 520/1021] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:33.118687 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:33.119305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:33.125812 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.126293 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.126730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.127423 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.127888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.128316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.257696 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:33.265272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8dd7a359-cec0-4418-98bf-29c9026cbe6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.150478 Oct 04 08:57:33.265865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 502/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:33 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:34.290315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:34.291061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:34.297258 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:34.297799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:34.298244 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:34.298949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:34.299410 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:34.299841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:34.428206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:34.437959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-02f82978-6729-4f00-ad4e-2ef8f316f9f4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.153197 Oct 04 08:57:34.438536 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 521/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:34 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:35.460618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:35.461247 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:35.467576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.468048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.468474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.469157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.469603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.470044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.604572 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:35.612079 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-4d11d73b-fd9d-4065-92f6-656405e1f72f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.155557 Oct 04 08:57:35.612630 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 503/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:35 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:36.634944 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:36.635562 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:36.641932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:36.642426 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:36.642864 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:36.643551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:36.644005 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:36.644430 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:36.770065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:36.777627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-048175f0-2aa9-4025-8fb4-ee2eded7f1ad tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.146520 Oct 04 08:57:36.778208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 522/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:36 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:37.800096 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:37.801908 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:37.808207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:37.808693 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:37.809132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:37.809855 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:37.810310 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:37.810741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:37.943240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:37.951208 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a0d70902-9e5b-4e9b-8900-a28ca0ede1fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.154878 Oct 04 08:57:37.951846 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 504/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:37 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:38.974638 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:38.975230 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:38.981558 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.982073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.982508 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.983194 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.983659 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.984077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.108670 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:39.116281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-373fb6fe-ec6a-4f99-8939-ecf1e8462b77 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.145535 Oct 04 08:57:39.116838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 523/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:38 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:40.139309 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:40.139916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:40.142432 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:40.147854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.148331 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.148761 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.149468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.149957 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.150402 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.279662 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:40.287297 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3a4caa33-f834-4187-97a3-2aaeb685ad41 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.151918 Oct 04 08:57:40.287857 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 505/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:40 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:41.311382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:41.312157 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:41.315317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:41.316130 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:41.321567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.322108 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.322551 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.323251 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.323988 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.324422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.481087 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:41.490078 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-065c3cc7-948e-4b13-9d39-7e523610d716 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.183531 Oct 04 08:57:41.490665 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 524/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:41 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:42.516386 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:42.517176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:42.523527 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.524002 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.524627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.525315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.525800 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.526207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.665671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:42.673242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5f61f588-e5a6-4b40-823a-df72cbd3c41c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.160763 Oct 04 08:57:42.673891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 506/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:42 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:43.475651 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-ececcc0d-9f1b-489f-a720-d54f5b9fd6b0 req-8f247266-0bcd-4564-ba17-6b0d13daed4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e8c036-5f98-4049-8672-6345ca8497d9", "name": "network-vif-plugged", "status": "completed", "tag": "2e14b84c-0e13-4974-a9f9-6249502dcba3"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:43.485048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ececcc0d-9f1b-489f-a720-d54f5b9fd6b0 req-8f247266-0bcd-4564-ba17-6b0d13daed4d service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.485526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ececcc0d-9f1b-489f-a720-d54f5b9fd6b0 req-8f247266-0bcd-4564-ba17-6b0d13daed4d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.486000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ececcc0d-9f1b-489f-a720-d54f5b9fd6b0 req-8f247266-0bcd-4564-ba17-6b0d13daed4d service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.497170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-ececcc0d-9f1b-489f-a720-d54f5b9fd6b0 req-8f247266-0bcd-4564-ba17-6b0d13daed4d service nova] Creating event network-vif-plugged:2e14b84c-0e13-4974-a9f9-6249502dcba3 for instance a6e8c036-5f98-4049-8672-6345ca8497d9 on hv-cinder-86021 Oct 04 08:57:43.502131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-ececcc0d-9f1b-489f-a720-d54f5b9fd6b0 req-8f247266-0bcd-4564-ba17-6b0d13daed4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 Oct 04 08:57:43.502755 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 525/1031] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:43.696990 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:43.697809 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:43.704382 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.704973 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.705410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.706140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.706592 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.707029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.838197 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:43.849779 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0e0e9984-bcc0-433e-b890-5b26904292ef tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.157237 Oct 04 08:57:43.850335 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 507/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:43 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:44.872028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:44.872726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:44.878921 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.879491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.879790 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.880477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.880924 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.881345 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.016771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:45.024986 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-454b5b6f-bfd0-4468-b4aa-300bb42fb3ed tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1362 microversion: 2.1 time: 0.157629 Oct 04 08:57:45.025540 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 526/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:44 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:46.048891 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:46.049503 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:46.056455 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.056940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.057377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.058087 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.058541 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.058964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.191069 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:46.199279 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9366e5ae-8691-4112-a46e-e59f5b690b20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1547 microversion: 2.1 time: 0.154228 Oct 04 08:57:46.199837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 508/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:46 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:46.223479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:46.223971 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:46.230596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.231080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.231520 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.232212 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.232965 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.233115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.314315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9e78d699-5600-4912-bd6d-25bf88eabc71 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094606 Oct 04 08:57:46.314881 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 527/1035] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 08:57:46 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:47.246551 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-f10d499b-8145-41cb-8b43-557bc3f7c5de req-43d2e229-d77c-471b-8c1b-97d46663c923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e8c036-5f98-4049-8672-6345ca8497d9", "tag": "2e14b84c-0e13-4974-a9f9-6249502dcba3"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:47.256318 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-f10d499b-8145-41cb-8b43-557bc3f7c5de req-43d2e229-d77c-471b-8c1b-97d46663c923 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:47.256815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-f10d499b-8145-41cb-8b43-557bc3f7c5de req-43d2e229-d77c-471b-8c1b-97d46663c923 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:47.257245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-f10d499b-8145-41cb-8b43-557bc3f7c5de req-43d2e229-d77c-471b-8c1b-97d46663c923 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.268212 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-f10d499b-8145-41cb-8b43-557bc3f7c5de req-43d2e229-d77c-471b-8c1b-97d46663c923 service nova] Creating event network-changed:2e14b84c-0e13-4974-a9f9-6249502dcba3 for instance a6e8c036-5f98-4049-8672-6345ca8497d9 on hv-cinder-86021 Oct 04 08:57:47.273256 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-f10d499b-8145-41cb-8b43-557bc3f7c5de req-43d2e229-d77c-471b-8c1b-97d46663c923 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030501 Oct 04 08:57:47.273887 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 509/1036] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:10.995886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:10.996630 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=46 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:10.999138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:11.000601 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=50 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:11.002741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:11.003388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:11.006625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-7f357edf-0811-42f7-b25b-a104c3cbff80 req-dd247cfc-678f-43e9-a6e8-18ba15046dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b563fa-625b-4039-9c45-60a47f917213", "tag": "441ff4e6-5e52-45de-9c56-3a4ad0191457"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:11.010949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.011368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.011801 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.012620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.013073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.013493 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.019667 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-7f357edf-0811-42f7-b25b-a104c3cbff80 req-dd247cfc-678f-43e9-a6e8-18ba15046dc8 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.020157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-7f357edf-0811-42f7-b25b-a104c3cbff80 req-dd247cfc-678f-43e9-a6e8-18ba15046dc8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.020591 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-7f357edf-0811-42f7-b25b-a104c3cbff80 req-dd247cfc-678f-43e9-a6e8-18ba15046dc8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.032368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-7f357edf-0811-42f7-b25b-a104c3cbff80 req-dd247cfc-678f-43e9-a6e8-18ba15046dc8 service nova] Creating event network-changed:441ff4e6-5e52-45de-9c56-3a4ad0191457 for instance 86b563fa-625b-4039-9c45-60a47f917213 on hv-cinder-86021 Oct 04 08:59:11.037535 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-7f357edf-0811-42f7-b25b-a104c3cbff80 req-dd247cfc-678f-43e9-a6e8-18ba15046dc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040744 Oct 04 08:59:11.038400 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 510/1037] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:59:11.041294 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:59:11.126200 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b8765e64-bfdb-42ac-8b7f-5c445a749251 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "DELETE /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 204 len: 0 microversion: 2.1 time: 0.132123 Oct 04 08:59:11.127272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 528/1038] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:10 2022] DELETE /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:59:11.136878 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:11.138237 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:11.146519 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.147161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.147851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.148576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.149037 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.149470 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.290060 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:11.297772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2a7ea0c3-4b65-4e83-a08f-cb33f5d6c326 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1576 microversion: 2.1 time: 0.165529 Oct 04 08:59:11.298334 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 511/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:11 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:12.323399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:12.323989 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:12.330281 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:12.330758 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:12.331188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.331877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:12.332320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:12.332737 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.527055 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:12.535555 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0216e148-a99e-4cff-ba1a-c3df67a113a0 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1576 microversion: 2.1 time: 0.216424 Oct 04 08:59:12.536139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 529/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:12 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:13.558758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:13.559369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:13.565410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:13.565922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:13.566361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:13.567050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:13.567502 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:13.567924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:13.705305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:13.713724 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ce97d4bd-13a6-455a-9152-6a92381c8242 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1457 microversion: 2.1 time: 0.158776 Oct 04 08:59:13.714378 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 512/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:13 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:13.749170 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-ed08d8c5-346e-4512-9f00-b30d27966d39 req-8bd8b660-4e9f-413b-ad52-e15a9bdedbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b563fa-625b-4039-9c45-60a47f917213", "name": "network-vif-deleted", "tag": "441ff4e6-5e52-45de-9c56-3a4ad0191457"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:13.759929 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ed08d8c5-346e-4512-9f00-b30d27966d39 req-8bd8b660-4e9f-413b-ad52-e15a9bdedbea service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:13.760411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ed08d8c5-346e-4512-9f00-b30d27966d39 req-8bd8b660-4e9f-413b-ad52-e15a9bdedbea service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:13.760842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ed08d8c5-346e-4512-9f00-b30d27966d39 req-8bd8b660-4e9f-413b-ad52-e15a9bdedbea service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:13.771876 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-ed08d8c5-346e-4512-9f00-b30d27966d39 req-8bd8b660-4e9f-413b-ad52-e15a9bdedbea service nova] Creating event network-vif-deleted:441ff4e6-5e52-45de-9c56-3a4ad0191457 for instance 86b563fa-625b-4039-9c45-60a47f917213 on hv-cinder-86021 Oct 04 08:59:13.777313 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-ed08d8c5-346e-4512-9f00-b30d27966d39 req-8bd8b660-4e9f-413b-ad52-e15a9bdedbea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Oct 04 08:59:13.778028 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 530/1042] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:14.737897 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:14.738503 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:14.744649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.745124 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.745557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.746265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.746712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.747131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.777893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:14.778371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:14.778802 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:14.779242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lazy-loading 'fault' on Instance uuid 86b563fa-625b-4039-9c45-60a47f917213 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:14.823146 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:14.830107 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5daf47ce-89ee-4f1e-b5b6-dbbb30a9d0cd tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 200 len: 1182 microversion: 2.1 time: 0.096568 Oct 04 08:59:14.830660 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 513/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:14 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 1182 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:15.124493 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:15.125058 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:15.131181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.131657 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.132091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.132782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.133234 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.133658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.157498 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ffc722dd-1504-4310-ac84-486401500618 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/ips" status: 200 len: 145 microversion: 2.1 time: 0.037693 Oct 04 08:59:15.158092 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 531/1044] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 08:59:15 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:15.852259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:15.852864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: 86b563fa-625b-4039-9c45-60a47f917213] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:15.859839 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.860313 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.860746 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.861427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.861905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.862322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.875625 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] HTTP exception thrown: Instance 86b563fa-625b-4039-9c45-60a47f917213 could not be found. Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Request method failure captured: Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 HTTP/1.1 Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_OBUVlVtAzk4bHyWws0RHFgJzBXwBIAbJ8cWlSB8tOnyHqoA5hPysXIolJDBR45MRVpMhnqS-GL7iHSOh_uVzrQpxognyxodU1tq6-pFibGEmEJo4ogNLLpG92cycQt5gXA8yySuE-XLWwBgX0QHwcVqWDVaTHDDmPTv-edmmA8-c8 Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:59:15.877308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}] Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: f928852d90b94ac5979e4a7806896b7a Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 86b563fa-625b-4039-9c45-60a47f917213 could not be found. Oct 04 08:59:15.878905 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '86b563fa-625b-4039-9c45-60a47f917213'} Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b563fa-625b-4039-9c45-60a47f917213 could not be found. Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:15.879767 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b563fa-625b-4039-9c45-60a47f917213 could not be found. Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b563fa-625b-4039-9c45-60a47f917213 could not be found. Oct 04 08:59:15.881168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:15.882735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Returning 404 to user: Instance 86b563fa-625b-4039-9c45-60a47f917213 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:15.882735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-e23cd7a5-a685-47aa-b0fd-a6bb2515e87a tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213" status: 404 len: 111 microversion: 2.1 time: 0.030340 Oct 04 08:59:15.882735 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 514/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:15 2022] GET /compute/v2.1/servers/86b563fa-625b-4039-9c45-60a47f917213 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:17.136899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdaa9e55-32e2-46b6-858c-bf5037e51728"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:17.139304 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:17.146131 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.146617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.147049 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.147730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.148177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.148594 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.420355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5a0b2ccc-0239-40c6-ba47-0a312765fa8d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287157 Oct 04 08:59:17.420945 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 532/1046] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 08:59:17 2022] POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:18.929929 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:18.930627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:18.932694 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-0b0e0fc4-fff5-4dba-8aa8-0ab4e9c82644 req-f032c289-be8b-4dfb-b50c-42d637acd4fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d445b13f-7aa8-4ad3-8013-9f960b391f87", "tag": "5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:18.937357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.938381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.938851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.939759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.940282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.940743 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.942804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0b0e0fc4-fff5-4dba-8aa8-0ab4e9c82644 req-f032c289-be8b-4dfb-b50c-42d637acd4fa service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:18.943289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0b0e0fc4-fff5-4dba-8aa8-0ab4e9c82644 req-f032c289-be8b-4dfb-b50c-42d637acd4fa service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:18.943722 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0b0e0fc4-fff5-4dba-8aa8-0ab4e9c82644 req-f032c289-be8b-4dfb-b50c-42d637acd4fa service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:18.955912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-0b0e0fc4-fff5-4dba-8aa8-0ab4e9c82644 req-f032c289-be8b-4dfb-b50c-42d637acd4fa service nova] Creating event network-changed:5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee for instance d445b13f-7aa8-4ad3-8013-9f960b391f87 on hv-cinder-86021 Oct 04 08:59:18.962533 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-0b0e0fc4-fff5-4dba-8aa8-0ab4e9c82644 req-f032c289-be8b-4dfb-b50c-42d637acd4fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034200 Oct 04 08:59:18.963371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 533/1047] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:18.970201 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:59:19.054099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-5498e810-2462-4bbd-9499-868499c5db93 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 204 len: 0 microversion: 2.1 time: 0.127565 Oct 04 08:59:19.055316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 515/1048] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:18 2022] DELETE /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:59:19.065908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:19.066911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:19.073999 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:19.074502 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:19.074937 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:19.075649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:19.076105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:19.076530 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:19.212057 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:19.219857 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-61b821f2-5f05-4763-b4ac-a5d216c71b5b tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1578 microversion: 2.1 time: 0.159604 Oct 04 08:59:19.220424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 534/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:19 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:20.244373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:20.245072 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:20.251571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.252050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.252484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.253168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.253616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.254063 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.389964 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f928852d90b94ac5979e4a7806896b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1104ee1508e24a2b87820a8b0fafd0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:20.399881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6ad26146-596e-4a39-8bd8-2df7eadea8b5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 200 len: 1459 microversion: 2.1 time: 0.159797 Oct 04 08:59:20.400829 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 516/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:20 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 1459 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:20.536068 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-890d3abd-f1a3-4085-897d-26b00f4e9aaf req-19f75c3d-7e93-4cb8-bf84-cf47d0af7dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d445b13f-7aa8-4ad3-8013-9f960b391f87", "name": "network-vif-deleted", "tag": "5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:20.546002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-890d3abd-f1a3-4085-897d-26b00f4e9aaf req-19f75c3d-7e93-4cb8-bf84-cf47d0af7dc9 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.546479 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-890d3abd-f1a3-4085-897d-26b00f4e9aaf req-19f75c3d-7e93-4cb8-bf84-cf47d0af7dc9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.546939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-890d3abd-f1a3-4085-897d-26b00f4e9aaf req-19f75c3d-7e93-4cb8-bf84-cf47d0af7dc9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.557894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-890d3abd-f1a3-4085-897d-26b00f4e9aaf req-19f75c3d-7e93-4cb8-bf84-cf47d0af7dc9 service nova] Creating event network-vif-deleted:5cc4a9ff-bcdd-4d5b-bab5-9132e78b69ee for instance d445b13f-7aa8-4ad3-8013-9f960b391f87 on hv-cinder-86021 Oct 04 08:59:20.563110 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-890d3abd-f1a3-4085-897d-26b00f4e9aaf req-19f75c3d-7e93-4cb8-bf84-cf47d0af7dc9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030142 Oct 04 08:59:20.563677 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 535/1051] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:21.423871 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:21.424488 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: d445b13f-7aa8-4ad3-8013-9f960b391f87] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:21.431161 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.431654 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.432091 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.432823 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.433308 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.433795 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.447899 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] HTTP exception thrown: Instance d445b13f-7aa8-4ad3-8013-9f960b391f87 could not be found. Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Request method failure captured: Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 HTTP/1.1 Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_OBUVlVtAzk4bHyWws0RHFgJzBXwBIAbJ8cWlSB8tOnyHqoA5hPysXIolJDBR45MRVpMhnqS-GL7iHSOh_uVzrQpxognyxodU1tq6-pFibGEmEJo4ogNLLpG92cycQt5gXA8yySuE-XLWwBgX0QHwcVqWDVaTHDDmPTv-edmmA8-c8 Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:59:21.449622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}] Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: f928852d90b94ac5979e4a7806896b7a Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance d445b13f-7aa8-4ad3-8013-9f960b391f87 could not be found. Oct 04 08:59:21.451361 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'd445b13f-7aa8-4ad3-8013-9f960b391f87'} Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d445b13f-7aa8-4ad3-8013-9f960b391f87 could not be found. Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:21.452536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d445b13f-7aa8-4ad3-8013-9f960b391f87 could not be found. Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d445b13f-7aa8-4ad3-8013-9f960b391f87 could not be found. Oct 04 08:59:21.454149 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.455732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Returning 404 to user: Instance d445b13f-7aa8-4ad3-8013-9f960b391f87 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:21.455732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-6a46a440-f096-4ff8-b1c3-38fb8183ef90 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87" status: 404 len: 111 microversion: 2.1 time: 0.031664 Oct 04 08:59:21.455732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 517/1052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:21 2022] GET /compute/v2.1/servers/d445b13f-7aa8-4ad3-8013-9f960b391f87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:21.885016 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:21.885679 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:21.891737 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.892220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.892660 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.893350 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.893845 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.894258 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.907688 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] HTTP exception thrown: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Request method failure captured: Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf HTTP/1.1 Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_OBUVlVtAzk4bHyWws0RHFgJzBXwBIAbJ8cWlSB8tOnyHqoA5hPysXIolJDBR45MRVpMhnqS-GL7iHSOh_uVzrQpxognyxodU1tq6-pFibGEmEJo4ogNLLpG92cycQt5gXA8yySuE-XLWwBgX0QHwcVqWDVaTHDDmPTv-edmmA8-c8 Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 08:59:21.909302 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}] Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: f928852d90b94ac5979e4a7806896b7a Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.911045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'b291a8e2-ddea-408e-b850-2a968115efcf'} Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:21.912004 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.913531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.915276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Returning 404 to user: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:21.915276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-39b6ab66-d75c-4632-9d25-8e2c48680d72 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 404 len: 111 microversion: 2.1 time: 0.030519 Oct 04 08:59:21.915276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 536/1053] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:21 2022] DELETE /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:21.919137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:21.919756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] [instance: b291a8e2-ddea-408e-b850-2a968115efcf] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:21.926213 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.926690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.927123 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.927811 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:21.928269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:21.928695 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:21.941773 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] HTTP exception thrown: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Request method failure captured: Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf HTTP/1.1 Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_OBUVlVtAzk4bHyWws0RHFgJzBXwBIAbJ8cWlSB8tOnyHqoA5hPysXIolJDBR45MRVpMhnqS-GL7iHSOh_uVzrQpxognyxodU1tq6-pFibGEmEJo4ogNLLpG92cycQt5gXA8yySuE-XLWwBgX0QHwcVqWDVaTHDDmPTv-edmmA8-c8 Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 08:59:21.943303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1104ee1508e24a2b87820a8b0fafd0e1"}]}] Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 1104ee1508e24a2b87820a8b0fafd0e1 Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-TestVolumeBootPattern-716806877 Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: f928852d90b94ac5979e4a7806896b7a Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-TestVolumeBootPattern-716806877-project Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.945076 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'b291a8e2-ddea-408e-b850-2a968115efcf'} Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:21.946240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. Oct 04 08:59:21.947772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 08:59:21.949137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Returning 404 to user: Instance b291a8e2-ddea-408e-b850-2a968115efcf could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:21.949137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-33a66147-7e39-4ab7-bc17-36b5e400f8a5 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf" status: 404 len: 111 microversion: 2.1 time: 0.029278 Oct 04 08:59:21.949137 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 518/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:21 2022] GET /compute/v2.1/servers/b291a8e2-ddea-408e-b850-2a968115efcf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:23.230897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2103e381-4737-48df-b4da-2b54fbf145a9 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] Calling method '.version_select at 0x7f5fd4230ee0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:23.250974 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2103e381-4737-48df-b4da-2b54fbf145a9 tempest-TestVolumeBootPattern-716806877 tempest-TestVolumeBootPattern-716806877-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-322513154" status: 202 len: 0 microversion: 2.1 time: 0.023186 Oct 04 08:59:23.251632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 537/1055] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 4 08:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-322513154 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:24.967198 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-513454c8-c41e-41f6-9ba8-fe7fb6acdc83 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:24.974120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-513454c8-c41e-41f6-9ba8-fe7fb6acdc83 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:24.974601 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-513454c8-c41e-41f6-9ba8-fe7fb6acdc83 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:24.975043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-513454c8-c41e-41f6-9ba8-fe7fb6acdc83 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:25.036004 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-513454c8-c41e-41f6-9ba8-fe7fb6acdc83 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Going to try to stop instance {{(pid=126939) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 08:59:25.084018 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-513454c8-c41e-41f6-9ba8-fe7fb6acdc83 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action" status: 202 len: 0 microversion: 2.1 time: 0.120082 Oct 04 08:59:25.085156 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 519/1056] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:59:24 2022] POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:25.094411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:25.095155 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:25.103426 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:25.104197 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:25.104981 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:25.105915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:25.106554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:25.107124 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:25.318284 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:25.327045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d353feb9-bdda-42ee-8f6a-887e0447e9fa tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.237733 Oct 04 08:59:25.327701 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 538/1057] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:25 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:26.352362 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:26.353166 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:26.360920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:26.361434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:26.361862 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:26.366718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:26.367196 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:26.367634 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:26.528901 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:26.537707 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-44349c49-73eb-41c5-9d0a-5fe20b970a35 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.190108 Oct 04 08:59:26.538292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 520/1058] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:26 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:27.561995 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:27.562707 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:27.569854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:27.570485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:27.571032 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:27.571847 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:27.572406 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:27.572956 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:27.719771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:27.728902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-da7338ba-9db4-43ef-8c6b-a8b1bb6f7328 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.170974 Oct 04 08:59:27.729473 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 539/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:27 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:28.752716 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:28.753280 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:28.759985 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.760477 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.760916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:28.761627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.762120 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.762548 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:29.083254 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:29.091992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8f1db010-b43f-4e95-a0f4-2ca785ac1d1c tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.343775 Oct 04 08:59:29.092564 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 521/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:28 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:30.116505 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:30.119973 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:30.128161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.128330 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.129782 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.130143 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.131072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.131640 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.266305 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:30.274605 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c862a8cb-d41f-4c5b-86f5-95f3699c5fb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.162815 Oct 04 08:59:30.275290 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 540/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:30 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:31.298488 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:31.299126 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:31.305531 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.306045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.306484 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.307169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.307622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.308045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.439689 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:31.447768 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-bbdf1172-9de3-4ff4-a1b6-6d70ef833245 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.153118 Oct 04 08:59:31.448328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 522/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:31 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:32.472682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:32.473097 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:32.479429 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.479905 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.480334 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:32.481014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.481461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.481916 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:32.607102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:32.615838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-18209a2f-f622-4c66-8cd0-cc6d7e08200b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.147828 Oct 04 08:59:32.616403 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 541/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:32 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:33.639851 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:33.640480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:33.646822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:33.647351 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:33.647780 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:33.648474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:33.648962 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:33.649394 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:33.776729 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:33.785397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-06a10158-1272-491f-86f3-0d3bb61d1482 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.150308 Oct 04 08:59:33.785987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 523/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:33 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:34.808984 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:34.809599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:34.816611 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.817055 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.817490 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.818207 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.818667 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.819091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.952427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:34.960932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a2aaa207-9418-43b5-9045-28294ef6f343 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.155835 Oct 04 08:59:34.961498 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 542/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:34 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:35.984474 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:35.985021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:35.991472 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.991958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.992396 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.993089 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.993543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.993997 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.118992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:36.127718 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ce5247ef-2403-419e-ba6c-af5a43586916 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.147311 Oct 04 08:59:36.128281 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 524/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:35 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:37.151620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:37.152169 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:37.158557 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.159044 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.159482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.160176 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.160629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.161052 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.287804 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:37.295910 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cf77fa11-e603-4a9e-9a75-f05769e507f2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.148209 Oct 04 08:59:37.296476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 543/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:37 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:38.319701 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:38.320372 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:38.326875 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.327397 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.327838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.329174 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.329622 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.330111 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.457717 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:38.466031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1104ce47-35a8-4338-951e-6ef64c8d17af tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.150317 Oct 04 08:59:38.466587 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 525/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:38 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:39.489161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:39.489814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:39.496276 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:39.496760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:39.497201 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:39.497932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:39.498392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:39.498843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:39.628336 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:39.636598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1c18ca9c-2df5-42bc-b89e-5610c7dd55a8 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1722 microversion: 2.1 time: 0.151389 Oct 04 08:59:39.637165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 544/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:39 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:40.660917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:40.661523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:40.667904 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.668375 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.668832 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.669513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.669989 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.670409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.675008 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:40.800532 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:40.808647 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-efef1a5a-362d-4e8b-99c4-f38d63f766de tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1699 microversion: 2.1 time: 0.151634 Oct 04 08:59:40.809207 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 526/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:40 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:40.831121 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b031a058-5910-42b2-9d50-cdd72a77037b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:40.837822 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b031a058-5910-42b2-9d50-cdd72a77037b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.838311 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b031a058-5910-42b2-9d50-cdd72a77037b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.838760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b031a058-5910-42b2-9d50-cdd72a77037b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.892107 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:40.899291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b031a058-5910-42b2-9d50-cdd72a77037b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Going to try to start instance {{(pid=126938) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 08:59:40.941177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b031a058-5910-42b2-9d50-cdd72a77037b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action" status: 202 len: 0 microversion: 2.1 time: 0.113750 Oct 04 08:59:40.941831 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 545/1071] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 08:59:40 2022] POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:40.950108 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:40.950761 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:40.957471 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.958016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.958512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.959230 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.959933 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.960352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:41.097022 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:41.105303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fe2ab039-e9d0-4c5d-9b9f-84600945712d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1708 microversion: 2.1 time: 0.159247 Oct 04 08:59:41.106440 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 527/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:40 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:42.129120 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.129941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.133048 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:42.137897 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.138384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.138823 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.139519 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.139964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.140392 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.276089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:42.284827 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b9e2572c-8201-477a-970e-de6d8bab54da tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1708 microversion: 2.1 time: 0.160140 Oct 04 08:59:42.285430 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 546/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:42 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:43.309020 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.309639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.315572 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:43.317382 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.317879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.318316 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.319043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.319503 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.319953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.447969 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:43.456261 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1d82eac3-5b11-4047-8eb8-37b26c5c5d20 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1712 microversion: 2.1 time: 0.151291 Oct 04 08:59:43.456815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 528/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:43 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:38.716279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:38.716821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:38.719436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:38.720077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:38.725584 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:38.726102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:38.726539 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:38.727229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:38.727692 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:38.728118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:38.806816 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lazy-loading 'services' on Instance uuid a6e8c036-5f98-4049-8672-6345ca8497d9 {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:00:38.880115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-314a1b8a-095d-478c-9571-1b50a4b59690 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-volume_attachments/fdaa9e55-32e2-46b6-858c-bf5037e51728" status: 202 len: 0 microversion: 2.1 time: 0.167800 Oct 04 09:00:38.880723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 547/1075] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 09:00:38 2022] DELETE /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-volume_attachments/fdaa9e55-32e2-46b6-858c-bf5037e51728 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:40.004686 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-68b7b02d-e52b-499c-884c-222a30e7c235 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:40.006758 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:40.007430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=16 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:40.013468 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68b7b02d-e52b-499c-884c-222a30e7c235 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:40.013974 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68b7b02d-e52b-499c-884c-222a30e7c235 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:40.014413 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-68b7b02d-e52b-499c-884c-222a30e7c235 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:40.038636 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-68b7b02d-e52b-499c-884c-222a30e7c235 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Going to try to stop instance {{(pid=126939) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 09:00:40.078785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-68b7b02d-e52b-499c-884c-222a30e7c235 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action" status: 202 len: 0 microversion: 2.1 time: 0.078937 Oct 04 09:00:40.079314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 529/1076] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 09:00:39 2022] POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:40.088894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:40.089598 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:40.096553 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:40.097057 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:40.097495 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:40.098247 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:40.098728 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:40.099158 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:40.388222 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:40.396320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-d1a5674e-7244-4c13-9639-34dc13384373 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.312470 Oct 04 09:00:40.397713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 548/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:40 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:41.424458 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:41.425150 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:41.431260 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:41.431732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:41.432157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:41.432837 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:41.433282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:41.433711 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:41.619194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:41.626845 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-a489236e-24b2-4053-aa09-39a6971d27d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.207758 Oct 04 09:00:41.627410 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 530/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:41 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:42.650190 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:42.650838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:42.657481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:42.658040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:42.658477 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:42.659171 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:42.659626 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:42.660050 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:42.784229 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:42.791843 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a7ae20a7-7645-47e5-8011-943c250b75dd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.145717 Oct 04 09:00:42.792409 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 549/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:42 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:43.817253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:43.817890 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:43.823882 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:43.824357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:43.824786 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:43.825466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:43.825943 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:43.826362 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:43.952013 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:43.959567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1f60b8c5-854e-4ac9-bf83-4d94de0612b6 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.146179 Oct 04 09:00:43.960154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 531/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:43 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:44.983013 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:44.983629 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:44.990472 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:44.990959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:44.991395 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:44.992085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:44.992537 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:44.992962 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:45.117571 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:45.125731 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-4e134fa2-95d2-4fa9-8b32-46dae86ba7db tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.146610 Oct 04 09:00:45.126293 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 550/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:44 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:46.149824 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:46.150420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:46.157327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:46.157831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:46.158268 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:46.158947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:46.159394 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:46.159813 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:46.286218 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:46.293921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-836f1b6a-c3e2-498c-9fc6-f4bf43758a18 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.147859 Oct 04 09:00:46.294475 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 532/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:46 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:47.316443 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:47.317061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:47.323399 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:47.323886 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:47.324325 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:47.325018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:47.325471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:47.325930 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:47.455202 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:47.463146 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6640927e-5395-464a-b3ed-98aa89c3f7b7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.150630 Oct 04 09:00:47.463708 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 551/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:47 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:48.486691 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:48.487298 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:48.493898 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:48.494381 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:48.494814 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:48.495505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:48.495953 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:48.496373 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:48.625576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:48.633238 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7c834d9e-227e-4a27-b3d6-6d0190a41c16 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.150371 Oct 04 09:00:48.633827 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 533/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:48 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:49.657001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:49.657615 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:49.664133 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:49.664608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:49.665040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:49.665745 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:49.666198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:49.666623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:49.792141 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:49.800345 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ad1095d6-5f26-4bca-b214-39ebc0347308 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1676 microversion: 2.1 time: 0.147760 Oct 04 09:00:49.800904 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 552/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:49 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:50.823226 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:50.823840 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:50.830831 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:50.831314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:50.831750 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:50.832445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:50.832903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:50.833330 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:50.960926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:50.969225 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-78a0f031-4d0e-41b7-9b05-cb7717b36b5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1653 microversion: 2.1 time: 0.149205 Oct 04 09:00:50.969796 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 534/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:50 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:50.991350 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f1249e1c-2c94-4328-b2b5-dff709bb6635 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:50.997712 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1249e1c-2c94-4328-b2b5-dff709bb6635 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:50.998198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1249e1c-2c94-4328-b2b5-dff709bb6635 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:50.998628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f1249e1c-2c94-4328-b2b5-dff709bb6635 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:51.012623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:00:51.012775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Tue Oct 4 09:00:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action (ip 10.222.0.26) !!! Oct 04 09:00:51.028550 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f1249e1c-2c94-4328-b2b5-dff709bb6635 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Going to try to start instance {{(pid=126938) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 09:00:51.070091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f1249e1c-2c94-4328-b2b5-dff709bb6635 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action" status: 202 len: 0 microversion: 2.1 time: 0.082363 Oct 04 09:00:51.070740 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 553/1087] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 09:00:50 2022] POST /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:51.079407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:51.080045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:51.082073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:00:51.082243 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Tue Oct 4 09:00:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 (ip 10.222.0.26) !!! Oct 04 09:00:51.083285 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:00:51.083427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Tue Oct 4 09:00:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 (ip 10.222.0.26) !!! Oct 04 09:00:51.091114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:51.091611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:51.092043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:51.092736 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:51.093221 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:51.093641 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:51.228665 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:51.236530 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7df6e112-7bdb-4cf9-8d2e-896537e12537 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1662 microversion: 2.1 time: 0.161500 Oct 04 09:00:51.237114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 535/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:51 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:52.261617 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:52.262343 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:52.268456 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:52.268933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:52.269362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:52.270080 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:52.270529 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:52.270949 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:52.402814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:52.410734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a00e8318-2f53-43d9-99ac-07a7ea456451 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1662 microversion: 2.1 time: 0.153894 Oct 04 09:00:52.411296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 554/1089] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:52 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:53.434878 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:53.435554 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:53.442536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:53.443026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:53.443465 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:53.444162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:53.444620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:53.445048 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:53.571001 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:53.578620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3a06bbcc-a5c4-4619-8dc0-ffd82c4e5720 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1666 microversion: 2.1 time: 0.148106 Oct 04 09:00:53.579204 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 536/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:53 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:01:56.764082 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=16 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:56.764825 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:56.769332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:56.771646 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:56.778498 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.778982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.779421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.780109 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.780564 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.780987 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.811200 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-39a828d0-1a17-41f2-a048-d72e9f3d478e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048808 Oct 04 09:01:56.811678 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 555/1091] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 09:01:56 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:01:56.872903 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=16 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:56.873648 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:56.877756 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:56.878741 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:56.885817 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.886299 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.886736 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.887424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:56.887877 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:56.888299 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:56.913699 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:01:56.985644 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-82d041e3-9375-41ce-b16e-a1dfc662b257 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 204 len: 0 microversion: 2.1 time: 0.114300 Oct 04 09:01:56.986456 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 537/1092] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 09:01:56 2022] DELETE /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:01:56.995899 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:56.996519 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:57.002662 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.003655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.004101 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:57.004820 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:57.005261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:57.005743 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:57.135824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:57.144864 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a35bb6b8-819f-45be-a038-cceae741b620 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1672 microversion: 2.1 time: 0.153591 Oct 04 09:01:57.145439 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 556/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:56 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:58.168093 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:58.168789 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:58.175245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:58.175727 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:58.176184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:58.176858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:58.177312 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:58.177762 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:58.308073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:58.315798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-cc4dc5f8-b5bd-4a76-b272-375e3a73a7c7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1672 microversion: 2.1 time: 0.151970 Oct 04 09:01:58.316395 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 538/1094] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:58 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:59.340043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:59.340650 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:59.348135 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:59.348872 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:59.349314 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:59.350045 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:59.350501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:59.350917 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:59.482769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:59.491165 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-80dd89df-4bef-4c5f-a325-f360ed2bd402 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1672 microversion: 2.1 time: 0.155355 Oct 04 09:01:59.491734 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 557/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:59 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:00.468157 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-3ab3552e-6af2-4a42-8d59-c183755c9049 req-5edda06a-5773-43d6-a971-f4a95574e397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e8c036-5f98-4049-8672-6345ca8497d9", "name": "network-vif-deleted", "tag": "2e14b84c-0e13-4974-a9f9-6249502dcba3"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:00.478701 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-3ab3552e-6af2-4a42-8d59-c183755c9049 req-5edda06a-5773-43d6-a971-f4a95574e397 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.479184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-3ab3552e-6af2-4a42-8d59-c183755c9049 req-5edda06a-5773-43d6-a971-f4a95574e397 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.479617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-3ab3552e-6af2-4a42-8d59-c183755c9049 req-5edda06a-5773-43d6-a971-f4a95574e397 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.493059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-3ab3552e-6af2-4a42-8d59-c183755c9049 req-5edda06a-5773-43d6-a971-f4a95574e397 service nova] Creating event network-vif-deleted:2e14b84c-0e13-4974-a9f9-6249502dcba3 for instance a6e8c036-5f98-4049-8672-6345ca8497d9 on hv-cinder-86021 Oct 04 09:02:00.498804 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-3ab3552e-6af2-4a42-8d59-c183755c9049 req-5edda06a-5773-43d6-a971-f4a95574e397 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100187 Oct 04 09:02:00.499404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 539/1096] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:00.515390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:00.516011 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:00.524250 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.524862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.525421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.526261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.526815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.527334 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.571199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:00.571781 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:00.572301 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:00.572814 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lazy-loading 'fault' on Instance uuid a6e8c036-5f98-4049-8672-6345ca8497d9 {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:02:00.631177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:00.640635 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-41e8ccb1-20e4-4354-a014-278ee69eb7cd tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 200 len: 1326 microversion: 2.1 time: 0.129301 Oct 04 09:02:00.641205 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 558/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:00 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:01.665882 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:01.666605 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:01.672655 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:01.673132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:01.673562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:01.674276 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:01.675375 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:01.675799 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:01.688724 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] HTTP exception thrown: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Request method failure captured: Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 HTTP/1.1 Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_V37waLIQHIEKY99Lqm7ZBlu3Aydvm7H5In9vr7BG_pjXVzvOthEXaXM87wNJwuA_waob3CNctw5nrH6GLBzSHleaam1uunBjLnfyzju2vyMuOYOtwYhbAbJL8W8R6LUqma-nvr9uvLSk3-uWlsHDPv0wrJHjBhuMsc2DC7esilQeo Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 09:02:01.690357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4370b750fe184c5eade1378abfa02752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4370b750fe184c5eade1378abfa02752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}] Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: c710350e02634e84b3d4700ae5fa6925 Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:02:01.692147 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'a6e8c036-5f98-4049-8672-6345ca8497d9'} Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:02:01.693240 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:02:01.694951 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:02:01.696427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Returning 404 to user: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:02:01.696427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-1bd99eda-d102-448e-93c2-5a0e88810625 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 404 len: 111 microversion: 2.1 time: 0.030550 Oct 04 09:02:01.696427 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 540/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:01 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:02:01.700632 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1c38ed98-d40d-4a30-9f8f-c48d9b1659bb tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '.version_select at 0x7f5fd40d08b0>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:01.705235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1c38ed98-d40d-4a30-9f8f-c48d9b1659bb tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [18fa47ad-2efc-423d-bdfb-6e24e261534c] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 09:02:02.713610 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO oslo.messaging._drivers.impl_rabbit [None req-1c38ed98-d40d-4a30-9f8f-c48d9b1659bb tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [18fa47ad-2efc-423d-bdfb-6e24e261534c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 43560. Oct 04 09:02:02.731912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1c38ed98-d40d-4a30-9f8f-c48d9b1659bb tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837547927" status: 202 len: 0 microversion: 2.1 time: 1.035097 Oct 04 09:02:02.732483 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 559/1099] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 4 09:02:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837547927 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:02:03.345590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8172fd92-f85d-43a8-bd7c-d984642c4d30 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'create', calling method: .version_select at 0x7f5fd4300430>, body: {"keypair": {"name": "tempest-keypair-1182579719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZA1MhfhyJKQyLjiDOCg9yCGJ5lxnOhvWMZlhdkI83O+uPAktrm/++Swh/sfvB7Cw1ZpAKM4b+cHiDsVPB+zIZLmWHuDPTbgvLO/hDuSmO+YGOs5Mwt0tkAmBuTtKNX+g=="}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:03.361499 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-8172fd92-f85d-43a8-bd7c-d984642c4d30 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for project 4370b750fe184c5eade1378abfa02752. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:02:03.365327 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-8172fd92-f85d-43a8-bd7c-d984642c4d30 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for user c710350e02634e84b3d4700ae5fa6925 and project 4370b750fe184c5eade1378abfa02752. Resources: {'key_pairs'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:02:03.388978 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8172fd92-f85d-43a8-bd7c-d984642c4d30 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047293 Oct 04 09:02:03.389561 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 541/1100] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 09:02:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:04.610787 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-545922192", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cee735a-1c65-4161-98c7-3d57900a3b66"}], "security_groups": [{"name": "tempest-securitygroup--780368285"}], "key_name": "tempest-keypair-1182579719", "user_data": "}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:04.719812 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] validate_networks() for [('5cee735a-1c65-4161-98c7-3d57900a3b66', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:02:05.130872 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:02:05.131294 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:02:05.131763 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:02:05.132173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:02:05.132601 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:02:05.141177 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:05.141648 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:05.142105 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:05.142818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:05.143268 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:05.144297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:05.160506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for project 4370b750fe184c5eade1378abfa02752. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:02:05.164397 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Getting quotas for user c710350e02634e84b3d4700ae5fa6925 and project 4370b750fe184c5eade1378abfa02752. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:02:05.174937 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:02:05.177182 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:02:05.224895 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-5cc09441-6b1e-46b2-864e-ec4df042548d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.618894 Oct 04 09:02:05.225522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 560/1101] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 09:02:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:02:05.237407 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c6bde3a3-5359-43ad-afa0-85fef2083a32 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:05.238051 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c6bde3a3-5359-43ad-afa0-85fef2083a32 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:05.293153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c6bde3a3-5359-43ad-afa0-85fef2083a32 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:05.300012 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c6bde3a3-5359-43ad-afa0-85fef2083a32 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1237 microversion: 2.1 time: 0.067188 Oct 04 09:02:05.300563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 542/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:05 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:06.323556 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:06.324199 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:06.331301 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:06.331789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:06.332221 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:06.332908 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:06.333361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:06.333818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:06.421067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:06.429649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-daaee31d-a3c1-457d-8b8e-4674575ed9e2 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1297 microversion: 2.1 time: 0.110682 Oct 04 09:02:06.430374 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 561/1103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:06 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:07.452617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:07.453236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:07.460155 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:07.460642 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:07.461326 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:07.462047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:07.462498 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:07.462922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:07.598919 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:07.606858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-f8beed82-a846-4ba4-8a38-45b85b490cf4 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.158032 Oct 04 09:02:07.607430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 543/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:07 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:07.851252 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-ce4aa97a-f69d-4118-897a-a3400e0f71c9 req-d845ae90-2d73-4757-8ff0-b2efaf4361ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a0672b-ebbd-4431-8a81-881669323c61", "tag": "76b056c6-cd82-4e61-8651-63bd2cb3a3db"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:07.862072 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ce4aa97a-f69d-4118-897a-a3400e0f71c9 req-d845ae90-2d73-4757-8ff0-b2efaf4361ff service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:07.862572 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ce4aa97a-f69d-4118-897a-a3400e0f71c9 req-d845ae90-2d73-4757-8ff0-b2efaf4361ff service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:07.863000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-ce4aa97a-f69d-4118-897a-a3400e0f71c9 req-d845ae90-2d73-4757-8ff0-b2efaf4361ff service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:07.875501 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-ce4aa97a-f69d-4118-897a-a3400e0f71c9 req-d845ae90-2d73-4757-8ff0-b2efaf4361ff service nova] Creating event network-changed:76b056c6-cd82-4e61-8651-63bd2cb3a3db for instance 73a0672b-ebbd-4431-8a81-881669323c61 on hv-cinder-86021 Oct 04 09:02:07.881381 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-ce4aa97a-f69d-4118-897a-a3400e0f71c9 req-d845ae90-2d73-4757-8ff0-b2efaf4361ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033763 Oct 04 09:02:07.882000 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 562/1105] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:08.631772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:08.632385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:08.638708 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:08.639185 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:08.639615 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:08.640292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:08.640737 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:08.641154 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:08.766630 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:08.774656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fc98c42c-ab28-4c63-886e-f1597baa13cf tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.146679 Oct 04 09:02:08.775151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 544/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:08 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:09.798496 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:09.799194 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:09.806355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:09.806829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:09.807256 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:09.807961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:09.808411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:09.808829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:09.934515 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:09.942232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-35c28a45-30d4-4ed3-9124-d0d0d33d7835 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.147947 Oct 04 09:02:09.942796 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 563/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:09 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:10.964696 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:10.965271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:10.971570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:10.972043 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:10.972473 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:10.973151 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:10.973600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:10.974047 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:11.101476 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:11.108982 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-20db3ad2-c9d9-4662-80b4-850c4c61fd1a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.148516 Oct 04 09:02:11.109537 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 545/1108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:10 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:12.135118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:12.135726 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:12.142139 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:12.142620 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:12.143085 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:12.143771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:12.144223 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:12.144644 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:12.270627 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:12.278168 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-673449c8-8cae-4e6d-89ec-c0ad543a11fe tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.148823 Oct 04 09:02:12.278741 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 564/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:12 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:13.300852 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:13.302005 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:13.307865 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:13.308355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:13.308791 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:13.309482 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:13.309979 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:13.310409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:13.438012 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:13.446003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-218a246d-5181-499a-9c29-fc0236c54b24 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.149273 Oct 04 09:02:13.446569 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 546/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:13 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:14.470416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:14.471036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:14.477873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:14.478356 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:14.478788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:14.479471 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:14.479920 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:14.480339 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:14.611824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:14.619443 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3e69fd35-9005-43cb-8fb4-fec152a5b56a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.152862 Oct 04 09:02:14.620018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 565/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:14 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:14.782763 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-cbb8556a-e2bb-4fa9-ae21-7405091f5084 req-3ad8c7f1-6028-4ac1-b40a-f81cd7f68d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a0672b-ebbd-4431-8a81-881669323c61", "name": "network-vif-plugged", "status": "completed", "tag": "76b056c6-cd82-4e61-8651-63bd2cb3a3db"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:14.792733 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-cbb8556a-e2bb-4fa9-ae21-7405091f5084 req-3ad8c7f1-6028-4ac1-b40a-f81cd7f68d93 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:14.793211 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-cbb8556a-e2bb-4fa9-ae21-7405091f5084 req-3ad8c7f1-6028-4ac1-b40a-f81cd7f68d93 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:14.793637 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-cbb8556a-e2bb-4fa9-ae21-7405091f5084 req-3ad8c7f1-6028-4ac1-b40a-f81cd7f68d93 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:14.805612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-cbb8556a-e2bb-4fa9-ae21-7405091f5084 req-3ad8c7f1-6028-4ac1-b40a-f81cd7f68d93 service nova] Creating event network-vif-plugged:76b056c6-cd82-4e61-8651-63bd2cb3a3db for instance 73a0672b-ebbd-4431-8a81-881669323c61 on hv-cinder-86021 Oct 04 09:02:14.810585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-cbb8556a-e2bb-4fa9-ae21-7405091f5084 req-3ad8c7f1-6028-4ac1-b40a-f81cd7f68d93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087275 Oct 04 09:02:14.811153 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 547/1112] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:15.642390 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:15.643039 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:15.645649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:15.646317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:15.652727 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:15.653215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:15.653649 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:15.654368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:15.654858 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:15.655280 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:15.784376 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:15.791957 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-ed2d4176-9194-4e91-8f49-3345959dde46 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1362 microversion: 2.1 time: 0.153433 Oct 04 09:02:15.792526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 566/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:15 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:16.810842 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:16.815620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:16.816355 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:16.823301 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:16.823781 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:16.824219 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:16.824902 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:16.825353 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:16.825804 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:16.952912 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:02:16.961627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-929dfee1-3819-449f-b353-cc0fea435c25 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1547 microversion: 2.1 time: 0.151434 Oct 04 09:02:16.962319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 548/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:02:16 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:02:16.984711 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:02:16.985266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:02:16.992189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:16.992676 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:16.993117 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:16.993835 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:16.994295 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:16.994724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:17.071194 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-feaeab98-035b-415d-8d01-ac6d50310a5d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090366 Oct 04 09:02:17.071789 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 567/1115] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 09:02:16 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:02:18.221464 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-73bd0730-553c-4b1e-8edf-2ca340162001 req-53ecd510-39e1-48c6-9927-8e6c1a2c4126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a0672b-ebbd-4431-8a81-881669323c61", "tag": "76b056c6-cd82-4e61-8651-63bd2cb3a3db"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:02:18.231950 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-73bd0730-553c-4b1e-8edf-2ca340162001 req-53ecd510-39e1-48c6-9927-8e6c1a2c4126 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:02:18.232430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-73bd0730-553c-4b1e-8edf-2ca340162001 req-53ecd510-39e1-48c6-9927-8e6c1a2c4126 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:02:18.232864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-73bd0730-553c-4b1e-8edf-2ca340162001 req-53ecd510-39e1-48c6-9927-8e6c1a2c4126 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:02:18.243576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-73bd0730-553c-4b1e-8edf-2ca340162001 req-53ecd510-39e1-48c6-9927-8e6c1a2c4126 service nova] Creating event network-changed:76b056c6-cd82-4e61-8651-63bd2cb3a3db for instance 73a0672b-ebbd-4431-8a81-881669323c61 on hv-cinder-86021 Oct 04 09:02:18.248632 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-73bd0730-553c-4b1e-8edf-2ca340162001 req-53ecd510-39e1-48c6-9927-8e6c1a2c4126 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030889 Oct 04 09:02:18.249209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 549/1116] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:22.847064 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:22.847733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=64 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:22.907869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:22.908371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:22.914819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:22.915296 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:22.915730 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:22.916415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:22.916870 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:22.917291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:22.940768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-f4a3f309-d2ff-4028-a467-5d5fff92b2be tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/ips" status: 200 len: 144 microversion: 2.1 time: 0.095709 Oct 04 09:03:22.941319 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 568/1117] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 09:03:22 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/ips => generated 144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:24.263887 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:24.264623 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:24.269988 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc37ee9a-7571-4efd-9617-46060ecdfcd9"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:24.272868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:24.281200 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:24.281682 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:24.282140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:24.282830 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:24.283279 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:24.283699 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:24.541029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-000335d5-ee85-4243-bf5d-bb3b47636982 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279029 Oct 04 09:03:24.541656 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 550/1118] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 09:03:24 2022] POST /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:32.068889 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:32.071700 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:32.078121 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:32.078599 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:32.079031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:32.079712 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:32.080159 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:32.080576 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:32.109770 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-293fb6b2-2bcc-4701-acf8-5c19e94ebeb1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Oct 04 09:03:32.110309 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 569/1119] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 09:03:32 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:32.122714 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:32.123295 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:32.129398 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:32.129916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:32.130352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:32.131046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:32.131497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:32.131922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:32.159534 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-fa695ccc-9a8b-414c-ba88-5fb117333f6e tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/cc37ee9a-7571-4efd-9617-46060ecdfcd9" status: 200 len: 194 microversion: 2.1 time: 0.041726 Oct 04 09:03:32.160092 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 551/1120] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 4 09:03:32 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/cc37ee9a-7571-4efd-9617-46060ecdfcd9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:33.490362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9eb793a5-2dea-4536-b2ef-1b9cb8bc1101"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:33.492760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:33.499220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:33.499697 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:33.500126 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:33.500801 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:33.501248 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:33.501663 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:33.761526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b0d85a1b-a076-446e-9ee5-27b93f8bd784 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "POST /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274960 Oct 04 09:03:33.762189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 570/1121] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 09:03:33 2022] POST /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:03:41.289841 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:41.292052 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:41.298441 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:41.298947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:41.299380 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:41.300059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:41.300512 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:41.300926 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:41.330849 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7fc2f4ba-972f-492f-9439-dc96895a40d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044951 Oct 04 09:03:41.331388 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 552/1122] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 09:03:41 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:41.477894 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:41.478441 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:41.484485 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:41.484968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:41.485405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:41.486118 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:41.486574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:41.487003 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:41.515771 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-93c2ced8-d0d9-44db-b638-821e5222d8b1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/cc37ee9a-7571-4efd-9617-46060ecdfcd9" status: 200 len: 194 microversion: 2.1 time: 0.042821 Oct 04 09:03:41.516326 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 571/1123] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 4 09:03:41 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/cc37ee9a-7571-4efd-9617-46060ecdfcd9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:41.526509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:41.527008 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:41.532843 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:41.533324 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:41.533798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:41.534488 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:41.534937 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:41.535360 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:41.613616 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lazy-loading 'services' on Instance uuid 73a0672b-ebbd-4431-8a81-881669323c61 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:03:41.683920 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ca996283-a77a-4248-8fcb-8cd6fd72b9d5 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/cc37ee9a-7571-4efd-9617-46060ecdfcd9" status: 202 len: 0 microversion: 2.1 time: 0.161146 Oct 04 09:03:41.684486 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 553/1124] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 09:03:41 2022] DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/cc37ee9a-7571-4efd-9617-46060ecdfcd9 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:03:42.810138 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:42.810658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:42.816873 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:42.817358 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:42.818337 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:42.819291 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:42.819704 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:42.820145 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:42.849841 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-928a9bf5-2f0b-4a8e-aed6-db58485cc66f tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/9eb793a5-2dea-4536-b2ef-1b9cb8bc1101" status: 200 len: 194 microversion: 2.1 time: 0.043784 Oct 04 09:03:42.850417 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 572/1125] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 4 09:03:42 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/9eb793a5-2dea-4536-b2ef-1b9cb8bc1101 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:42.862103 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:42.862713 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:42.869246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:42.869752 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:42.870189 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:42.870867 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:42.871314 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:42.871732 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:42.950423 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lazy-loading 'services' on Instance uuid 73a0672b-ebbd-4431-8a81-881669323c61 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:03:43.020193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-7b1161c3-4c10-4ab1-93ac-4e0cc7787b36 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/9eb793a5-2dea-4536-b2ef-1b9cb8bc1101" status: 202 len: 0 microversion: 2.1 time: 0.162768 Oct 04 09:03:43.020739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 554/1126] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 09:03:42 2022] DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments/9eb793a5-2dea-4536-b2ef-1b9cb8bc1101 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 09:03:44.189910 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:44.192063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:44.199021 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.199508 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.199940 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.200626 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.201078 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.201499 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.230458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-24e61737-c728-42ed-9ae4-d5ca69f38271 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044478 Oct 04 09:03:44.231002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 573/1127] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 09:03:44 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:03:44.344548 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:44.346859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:44.353034 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.353509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.353972 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.354649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.355122 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.355539 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.385466 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d9b77e20-2a53-40d5-b739-f1b075a8e830 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045896 Oct 04 09:03:44.386081 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 555/1128] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 09:03:44 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 09:03:44.447448 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:44.447947 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:44.453833 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.454318 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.454756 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.455441 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.455895 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.456317 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.480370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:03:44.552874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-35e5e438-42b5-4355-86d7-6cc6ba176ff1 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 204 len: 0 microversion: 2.1 time: 0.109025 Oct 04 09:03:44.553576 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 574/1129] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 09:03:44 2022] DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:03:44.562621 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:44.563228 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:44.569626 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.570135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.570567 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.571248 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:44.571695 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:44.572114 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:44.704417 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:44.712430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8c99b700-44f1-4b71-861d-00c5e9eae7d7 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1671 microversion: 2.1 time: 0.153782 Oct 04 09:03:44.712992 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 556/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:44 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:45.736368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:45.737067 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:45.743457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:45.743932 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:45.744361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:45.745040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:45.745488 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:45.745939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:45.872458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:45.880051 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-018e56e6-6350-40cc-8af3-617de581a124 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1671 microversion: 2.1 time: 0.147936 Oct 04 09:03:45.881173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 575/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:45 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:46.904366 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:46.904917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:46.912201 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:46.912328 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:46.912720 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:46.913392 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:46.913873 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:46.914294 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:47.044633 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:47.052345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-85fa796b-67b1-4702-ae38-3f2b20f6e42a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1671 microversion: 2.1 time: 0.151920 Oct 04 09:03:47.052917 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 557/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:46 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:03:47.703682 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-0a144cd8-88c3-46fb-a96b-d9694c34e36e req-19615f79-83f5-43dc-b469-07bf8af7f429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a0672b-ebbd-4431-8a81-881669323c61", "name": "network-vif-deleted", "tag": "76b056c6-cd82-4e61-8651-63bd2cb3a3db"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:47.715315 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0a144cd8-88c3-46fb-a96b-d9694c34e36e req-19615f79-83f5-43dc-b469-07bf8af7f429 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:47.715786 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0a144cd8-88c3-46fb-a96b-d9694c34e36e req-19615f79-83f5-43dc-b469-07bf8af7f429 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:47.716427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-0a144cd8-88c3-46fb-a96b-d9694c34e36e req-19615f79-83f5-43dc-b469-07bf8af7f429 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:47.729440 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-0a144cd8-88c3-46fb-a96b-d9694c34e36e req-19615f79-83f5-43dc-b469-07bf8af7f429 service nova] Creating event network-vif-deleted:76b056c6-cd82-4e61-8651-63bd2cb3a3db for instance 73a0672b-ebbd-4431-8a81-881669323c61 on hv-cinder-86021 Oct 04 09:03:47.734408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-0a144cd8-88c3-46fb-a96b-d9694c34e36e req-19615f79-83f5-43dc-b469-07bf8af7f429 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035514 Oct 04 09:03:47.734998 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 576/1133] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:48.076520 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:48.077143 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:48.084163 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:48.084655 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:48.085099 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:48.085820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:48.086272 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:48.086963 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:48.118345 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:48.118820 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:48.119252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:48.119690 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.objects.instance [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lazy-loading 'fault' on Instance uuid 73a0672b-ebbd-4431-8a81-881669323c61 {{(pid=126939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:03:48.159491 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c710350e02634e84b3d4700ae5fa6925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4370b750fe184c5eade1378abfa02752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:48.167454 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-14b195bd-f099-49a4-a5a7-fc80cff4c162 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 200 len: 1327 microversion: 2.1 time: 0.094920 Oct 04 09:03:48.168025 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 558/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:48 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:49.192116 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:49.193374 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:49.199898 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:49.200371 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:49.200798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:49.201476 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:49.201953 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:49.202370 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:49.215608 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] HTTP exception thrown: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Request method failure captured: Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 HTTP/1.1 Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_V37waLIQHIEKY99Lqm7ZBlu3Aydvm7H5In9vr7BG_pjXVzvOthEXaXM87wNJwuA_waob3CNctw5nrH6GLBzSHleaam1uunBjLnfyzju2vyMuOYOtwYhbAbJL8W8R6LUqma-nvr9uvLSk3-uWlsHDPv0wrJHjBhuMsc2DC7esilQeo Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 09:03:49.217232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4370b750fe184c5eade1378abfa02752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4370b750fe184c5eade1378abfa02752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}] Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: c710350e02634e84b3d4700ae5fa6925 Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:49.219160 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '73a0672b-ebbd-4431-8a81-881669323c61'} Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:49.220215 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:49.222022 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:49.223543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Returning 404 to user: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:49.223543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c103cf7a-e01e-4c37-8d7a-0a7d2264242d tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 404 len: 111 microversion: 2.1 time: 0.030715 Oct 04 09:03:49.223543 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 577/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:49 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:03:49.227613 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c7098d16-ab8a-48ca-abd5-b422b536a3f9 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '.version_select at 0x7f5fd42f6e50>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:49.246429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c7098d16-ab8a-48ca-abd5-b422b536a3f9 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182579719" status: 202 len: 0 microversion: 2.1 time: 0.022711 Oct 04 09:03:49.246993 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 559/1136] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 09:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182579719 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:03:52.113928 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:52.114982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:52.121316 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.121836 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.122279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:52.122964 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.123418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.123840 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:52.137713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] HTTP exception thrown: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Request method failure captured: Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 HTTP/1.1 Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_V37waLIQHIEKY99Lqm7ZBlu3Aydvm7H5In9vr7BG_pjXVzvOthEXaXM87wNJwuA_waob3CNctw5nrH6GLBzSHleaam1uunBjLnfyzju2vyMuOYOtwYhbAbJL8W8R6LUqma-nvr9uvLSk3-uWlsHDPv0wrJHjBhuMsc2DC7esilQeo Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 09:03:52.139227 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4370b750fe184c5eade1378abfa02752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4370b750fe184c5eade1378abfa02752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}] Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: c710350e02634e84b3d4700ae5fa6925 Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.141041 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '73a0672b-ebbd-4431-8a81-881669323c61'} Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:52.142061 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.143685 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.145286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Returning 404 to user: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:52.145286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2d98daf4-2edb-474c-b08c-6a7999e542ba tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 404 len: 111 microversion: 2.1 time: 0.030552 Oct 04 09:03:52.145286 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 578/1137] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 09:03:52 2022] DELETE /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:03:52.149948 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:52.150562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: 73a0672b-ebbd-4431-8a81-881669323c61] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:52.157052 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.157529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.157994 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:52.158679 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.159132 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.159557 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:52.172168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] HTTP exception thrown: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Request method failure captured: Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 HTTP/1.1 Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_V37waLIQHIEKY99Lqm7ZBlu3Aydvm7H5In9vr7BG_pjXVzvOthEXaXM87wNJwuA_waob3CNctw5nrH6GLBzSHleaam1uunBjLnfyzju2vyMuOYOtwYhbAbJL8W8R6LUqma-nvr9uvLSk3-uWlsHDPv0wrJHjBhuMsc2DC7esilQeo Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 09:03:52.173858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4370b750fe184c5eade1378abfa02752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4370b750fe184c5eade1378abfa02752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}] Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: c710350e02634e84b3d4700ae5fa6925 Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.175603 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '73a0672b-ebbd-4431-8a81-881669323c61'} Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:52.176649 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. Oct 04 09:03:52.178835 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:52.180311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Returning 404 to user: Instance 73a0672b-ebbd-4431-8a81-881669323c61 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:52.180311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b0135ce8-548a-4cba-84f4-765335e1611a tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61" status: 404 len: 111 microversion: 2.1 time: 0.029846 Oct 04 09:03:52.180311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 560/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:52 2022] GET /compute/v2.1/servers/73a0672b-ebbd-4431-8a81-881669323c61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:03:53.313220 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:53.313750 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:53.316181 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:53.321951 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:53.322628 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:53.323225 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:53.323567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:53.324023 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:53.324568 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:53.328736 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:53.344587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] HTTP exception thrown: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Request method failure captured: Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: DELETE /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 HTTP/1.1 Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_V37waLIQHIEKY99Lqm7ZBlu3Aydvm7H5In9vr7BG_pjXVzvOthEXaXM87wNJwuA_waob3CNctw5nrH6GLBzSHleaam1uunBjLnfyzju2vyMuOYOtwYhbAbJL8W8R6LUqma-nvr9uvLSk3-uWlsHDPv0wrJHjBhuMsc2DC7esilQeo Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 09:03:53.346292 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4370b750fe184c5eade1378abfa02752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4370b750fe184c5eade1378abfa02752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}] Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: c710350e02634e84b3d4700ae5fa6925 Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.348075 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': 'a6e8c036-5f98-4049-8672-6345ca8497d9'} Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:53.348926 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.350548 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.352208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Returning 404 to user: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:53.352208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0acae0f8-bba1-4298-b4d4-b7005603763b tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 404 len: 111 microversion: 2.1 time: 0.038304 Oct 04 09:03:53.352208 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 579/1139] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 09:03:53 2022] DELETE /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:03:53.356848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:53.357467 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] [instance: a6e8c036-5f98-4049-8672-6345ca8497d9] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:53.363771 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:53.364246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:53.365212 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:53.365918 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:53.366368 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:53.366785 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:53.380628 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] HTTP exception thrown: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Request method failure captured: Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 HTTP/1.1 Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_V37waLIQHIEKY99Lqm7ZBlu3Aydvm7H5In9vr7BG_pjXVzvOthEXaXM87wNJwuA_waob3CNctw5nrH6GLBzSHleaam1uunBjLnfyzju2vyMuOYOtwYhbAbJL8W8R6LUqma-nvr9uvLSk3-uWlsHDPv0wrJHjBhuMsc2DC7esilQeo Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 09:03:53.382158 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4370b750fe184c5eade1378abfa02752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4370b750fe184c5eade1378abfa02752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4370b750fe184c5eade1378abfa02752"}]}] Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 4370b750fe184c5eade1378abfa02752 Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-504351029 Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: c710350e02634e84b3d4700ae5fa6925 Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-AttachVolumeTestJSON-504351029-project Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.383907 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': 'a6e8c036-5f98-4049-8672-6345ca8497d9'} Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:53.384879 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. Oct 04 09:03:53.386639 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:03:53.388086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] Returning 404 to user: Instance a6e8c036-5f98-4049-8672-6345ca8497d9 could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:53.388086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-26eaadc0-c23a-437d-9793-fcb62235ba79 tempest-AttachVolumeTestJSON-504351029 tempest-AttachVolumeTestJSON-504351029-project] 10.222.0.26 "GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9" status: 404 len: 111 microversion: 2.1 time: 0.030553 Oct 04 09:03:53.388086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 561/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:53 2022] GET /compute/v2.1/servers/a6e8c036-5f98-4049-8672-6345ca8497d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:04:25.843043 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1041276311", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452"}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:25.850434 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:25.896303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] validate_networks() for None {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:04:26.161213 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:04:26.161643 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:04:26.162179 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:04:26.162596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:04:26.163008 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:04:26.171769 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:26.172257 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:26.172699 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:26.173428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:26.173931 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:26.174361 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:26.190759 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Getting quotas for project 37c76a650ce1442ca18b129c109d1dbe. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:04:26.194684 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Getting quotas for user 6669ac4df7fb4a89acd662b2f8b5c07d and project 37c76a650ce1442ca18b129c109d1dbe. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:04:26.205347 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:04:26.208163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:04:26.254059 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-29cf98b1-da18-4830-9094-120b17e105ab tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415197 Oct 04 09:04:26.254714 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 580/1141] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 09:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:04:26.265838 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-26147816-308c-4337-ba7b-9d39396086e8 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:26.266538 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-26147816-308c-4337-ba7b-9d39396086e8 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:26.271193 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:26.271931 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:26.327714 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-26147816-308c-4337-ba7b-9d39396086e8 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:26.335084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-26147816-308c-4337-ba7b-9d39396086e8 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1215 microversion: 2.1 time: 0.073304 Oct 04 09:04:26.335640 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 562/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:26 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:27.358902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:27.359647 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:27.367238 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:27.368018 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:27.368672 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:27.369379 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:27.369874 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:27.370298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:27.449419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:27.457508 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-07bfdca0-d59a-4be3-b69d-12c9c816b712 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1285 microversion: 2.1 time: 0.102579 Oct 04 09:04:27.458091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 581/1143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:27 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:04:28.480359 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:28.480967 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:28.488684 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:28.489389 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:28.489854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:28.490571 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:28.491131 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:28.491795 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:28.633289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:28.643332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-11ce0b54-e5ba-4b96-8a2d-f1b8c324397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.166780 Oct 04 09:04:28.645184 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 563/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:28 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:29.106788 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-072df285-6b0a-4959-9e7c-1f365c0ae9ad req-7b6eaa42-23bb-49d6-8182-7d5dd09b53c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06737c93-4048-48d1-a3af-16fcc4c7fbcb", "tag": "3f26b5c6-b29a-44d9-b2fa-e98d6bd0b845"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:29.117883 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-072df285-6b0a-4959-9e7c-1f365c0ae9ad req-7b6eaa42-23bb-49d6-8182-7d5dd09b53c4 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:29.118368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-072df285-6b0a-4959-9e7c-1f365c0ae9ad req-7b6eaa42-23bb-49d6-8182-7d5dd09b53c4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:29.118821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-072df285-6b0a-4959-9e7c-1f365c0ae9ad req-7b6eaa42-23bb-49d6-8182-7d5dd09b53c4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:29.131691 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-072df285-6b0a-4959-9e7c-1f365c0ae9ad req-7b6eaa42-23bb-49d6-8182-7d5dd09b53c4 service nova] Creating event network-changed:3f26b5c6-b29a-44d9-b2fa-e98d6bd0b845 for instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb on hv-cinder-86021 Oct 04 09:04:29.136680 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-072df285-6b0a-4959-9e7c-1f365c0ae9ad req-7b6eaa42-23bb-49d6-8182-7d5dd09b53c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033736 Oct 04 09:04:29.137279 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 582/1145] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:29.667003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:29.667615 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:29.673958 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:29.674448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:29.674864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:29.675547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:29.676659 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:29.677078 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:29.805437 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:29.813060 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-62de411f-7956-4aa5-91c0-09345a1630ce tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.150013 Oct 04 09:04:29.813618 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 564/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:29 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:30.836658 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:30.837355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:30.843458 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:30.843937 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:30.844368 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:30.845046 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:30.845492 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:30.845933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:30.971415 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:30.979420 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cc1f1e0c-30ec-4658-b919-51e226f96897 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.147713 Oct 04 09:04:30.979979 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 583/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:30 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:32.002457 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:32.003016 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:32.009763 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:32.010242 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:32.010671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:32.011352 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:32.011797 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:32.012215 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:32.137311 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:32.144975 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b157bb9a-4704-42aa-a46b-9d14443b3891 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.146421 Oct 04 09:04:32.145543 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 565/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:31 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:33.167793 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:33.168391 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:33.174698 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:33.175178 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:33.176261 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:33.176962 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:33.177408 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:33.177862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:33.304457 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:33.312114 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-a2a38a4e-2b61-4fca-96f4-f3ba96857e0f tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.148163 Oct 04 09:04:33.312674 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 584/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:33 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:34.335644 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:34.336252 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:34.342810 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:34.343289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:34.343719 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:34.344405 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:34.344848 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:34.345265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:34.471763 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:34.479858 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d6a774c8-eafd-497d-a620-a8818de5e993 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.148612 Oct 04 09:04:34.480406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 566/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:34 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:35.437762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-aca3df59-89be-4ebc-a060-33cc687ac899 req-02916225-4eb0-4b8c-8281-9a083f5e1c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06737c93-4048-48d1-a3af-16fcc4c7fbcb", "name": "network-vif-plugged", "status": "completed", "tag": "3f26b5c6-b29a-44d9-b2fa-e98d6bd0b845"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:35.449047 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-aca3df59-89be-4ebc-a060-33cc687ac899 req-02916225-4eb0-4b8c-8281-9a083f5e1c88 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:35.449539 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-aca3df59-89be-4ebc-a060-33cc687ac899 req-02916225-4eb0-4b8c-8281-9a083f5e1c88 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:35.450014 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-aca3df59-89be-4ebc-a060-33cc687ac899 req-02916225-4eb0-4b8c-8281-9a083f5e1c88 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:35.461240 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-aca3df59-89be-4ebc-a060-33cc687ac899 req-02916225-4eb0-4b8c-8281-9a083f5e1c88 service nova] Creating event network-vif-plugged:3f26b5c6-b29a-44d9-b2fa-e98d6bd0b845 for instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb on hv-cinder-86021 Oct 04 09:04:35.467288 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-aca3df59-89be-4ebc-a060-33cc687ac899 req-02916225-4eb0-4b8c-8281-9a083f5e1c88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033193 Oct 04 09:04:35.468063 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 585/1151] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:35.502620 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:35.503245 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:35.510577 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:35.511074 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:35.511514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:35.512217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:35.512868 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:35.513300 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:35.651138 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:35.659724 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ce9c8374-7333-4050-a9ff-02e8f6d7bed7 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.160920 Oct 04 09:04:35.661086 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 567/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:35 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:36.679809 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:36.680574 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:36.685192 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:36.685928 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:36.693432 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:36.693941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:36.694375 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:36.695060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:36.695510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:36.695933 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:36.822206 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:36.829762 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e992b19e-8855-40af-9f1a-bd7110e91121 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1315 microversion: 2.1 time: 0.150879 Oct 04 09:04:36.830332 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 586/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:36 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:37.852511 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:37.853113 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:37.854990 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:37.860444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:37.860928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:37.861357 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:37.862059 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:37.862507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:37.862924 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:37.987828 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:37.995815 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-2db7f3b1-6312-4955-8200-23353ff24a2a tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1464 microversion: 2.1 time: 0.147166 Oct 04 09:04:37.996378 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 568/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:37 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:38.041484 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:38.042036 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:38.048289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:38.048773 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:38.049209 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:38.049914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:38.050364 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:38.050784 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:38.077487 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Going to try to terminate instance {{(pid=126938) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:04:38.150878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-65bf0129-6362-41bb-a4ce-03c24eed0d98 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "DELETE /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 204 len: 0 microversion: 2.1 time: 0.112877 Oct 04 09:04:38.151405 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 587/1155] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 09:04:38 2022] DELETE /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:04:38.160271 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:38.160939 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:38.166793 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:38.167269 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:38.167721 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:38.168406 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:38.168849 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:38.169265 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:38.299798 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:38.307845 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d4c9e573-24d1-4e28-a0b0-2b3d517e397c tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1470 microversion: 2.1 time: 0.151953 Oct 04 09:04:38.308404 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 569/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:38 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:39.331655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:39.332355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:39.339544 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:39.340024 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:39.340453 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:39.341138 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:39.341583 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:39.342031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:39.472878 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:39.480792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-1e5ac378-19b2-48b7-bb23-107310fa9719 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1470 microversion: 2.1 time: 0.153296 Oct 04 09:04:39.481355 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 588/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:39 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:40.359139 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-b475cd1f-12dc-4b6d-9be5-0c03a0a07e33 req-6f2528bf-2427-4fe8-9575-561f21354cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06737c93-4048-48d1-a3af-16fcc4c7fbcb", "name": "network-vif-deleted", "tag": "3f26b5c6-b29a-44d9-b2fa-e98d6bd0b845"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:40.371503 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b475cd1f-12dc-4b6d-9be5-0c03a0a07e33 req-6f2528bf-2427-4fe8-9575-561f21354cec service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:40.371987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b475cd1f-12dc-4b6d-9be5-0c03a0a07e33 req-6f2528bf-2427-4fe8-9575-561f21354cec service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:40.372412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-b475cd1f-12dc-4b6d-9be5-0c03a0a07e33 req-6f2528bf-2427-4fe8-9575-561f21354cec service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:40.385286 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-b475cd1f-12dc-4b6d-9be5-0c03a0a07e33 req-6f2528bf-2427-4fe8-9575-561f21354cec service nova] Creating event network-vif-deleted:3f26b5c6-b29a-44d9-b2fa-e98d6bd0b845 for instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb on hv-cinder-86021 Oct 04 09:04:40.391611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-b475cd1f-12dc-4b6d-9be5-0c03a0a07e33 req-6f2528bf-2427-4fe8-9575-561f21354cec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036390 Oct 04 09:04:40.392490 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 570/1158] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:40.504531 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:40.505154 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:40.512060 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:40.512554 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:40.512998 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:40.513720 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:40.514182 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:40.514631 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:40.546983 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:40.547470 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:40.547911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:40.548360 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lazy-loading 'fault' on Instance uuid 06737c93-4048-48d1-a3af-16fcc4c7fbcb {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:04:40.592821 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6669ac4df7fb4a89acd662b2f8b5c07d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c76a650ce1442ca18b129c109d1dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:40.601013 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-9e825456-6eef-4172-bc8c-dc45fff16f70 tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 200 len: 1305 microversion: 2.1 time: 0.100441 Oct 04 09:04:40.601573 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 589/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:40 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:41.623736 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:41.624429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] [instance: 06737c93-4048-48d1-a3af-16fcc4c7fbcb] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:41.631004 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:41.631482 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:41.631911 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:41.632585 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:41.633031 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:41.633448 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:41.646531 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.wsgi [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] HTTP exception thrown: Instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb could not be found. Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Request method failure captured: Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: request: GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb HTTP/1.1 Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept: application/json Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Accept-Encoding: identity Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Connection: close Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Length: 0 Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Content-Type: application/json Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Host: 10.222.0.26 Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Openstack-System-Scope: None Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: User-Agent: python-urllib3/1.26.12 Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Auth-Token: gAAAAABjO_cYRlrhVXzveE5oOBflkgL_SVlrIYzC5xAVBmB5zC_UEZAi0xed0Plk-eMyA-CCgZuwR5y9BL9mwSZmoJhhURDSaOnBWNaEqF8dwIojQ1EpTL0mFjpvOY05j93YAsJ37vIpuIsUjEOzCrXe1xhzrcwJ5IU1Xz07u5VznBz53Gk76CQ Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Id: None Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Domain-Name: None Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Identity-Status: Confirmed Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Is-Admin-Project: True Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Id: default Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Domain-Name: Default Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Id: 37c76a650ce1442ca18b129c109d1dbe Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Project-Name: tempest-VolumesNegativeTest-1970102773 Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Role: reader,member Oct 04 09:04:41.648169 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Roles: reader,member Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37c76a650ce1442ca18b129c109d1dbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37c76a650ce1442ca18b129c109d1dbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37c76a650ce1442ca18b129c109d1dbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37c76a650ce1442ca18b129c109d1dbe"}]}] Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant: tempest-VolumesNegativeTest-1970102773 Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Id: 37c76a650ce1442ca18b129c109d1dbe Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-Tenant-Name: tempest-VolumesNegativeTest-1970102773 Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User: tempest-VolumesNegativeTest-1970102773-project Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Id: default Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Domain-Name: Default Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Id: 6669ac4df7fb4a89acd662b2f8b5c07d Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: X-User-Name: tempest-VolumesNegativeTest-1970102773-project Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: method: > Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: exception: Instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb could not be found. Oct 04 09:04:41.650162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: action_args: {'id': '06737c93-4048-48d1-a3af-16fcc4c7fbcb'} Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb could not be found. Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:04:41.651349 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb could not be found. Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb could not be found. Oct 04 09:04:41.653546 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: ERROR nova.api.openstack.wsgi Oct 04 09:04:41.656021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] Returning 404 to user: Instance 06737c93-4048-48d1-a3af-16fcc4c7fbcb could not be found. {{(pid=126939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:04:41.656021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b06c4cd7-0b27-4bbe-9a15-5601c643b58e tempest-VolumesNegativeTest-1970102773 tempest-VolumesNegativeTest-1970102773-project] 10.222.0.26 "GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb" status: 404 len: 111 microversion: 2.1 time: 0.030060 Oct 04 09:04:41.656021 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 571/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:41 2022] GET /compute/v2.1/servers/06737c93-4048-48d1-a3af-16fcc4c7fbcb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:04:48.996939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-550641622", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "networks": [{"uuid": "33bebe93-2ca6-4734-8581-6b97a9b17f07"}]}} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:49.048676 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.network.neutron [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] validate_networks() for [('33bebe93-2ca6-4734-8581-6b97a9b17f07', None, None, None, None, None)] {{(pid=126938) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:04:49.390010 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Flavor limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:04:49.390435 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Image limits 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:04:49.390912 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Flavor pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:04:49.391322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Image pref 0:0:0 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:04:49.391733 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.virt.hardware [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:04:49.401102 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:49.401579 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:49.402040 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:49.402757 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:49.403204 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:49.403655 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:49.420596 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Getting quotas for project 2e1fb35e7be541c8bec40499ed3ac2d2. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:04:49.424636 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.quota [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Getting quotas for user e76f24263ef74c28b99e1f882071bf5b and project 2e1fb35e7be541c8bec40499ed3ac2d2. Resources: {'instances', 'cores', 'ram'} {{(pid=126938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:04:49.435936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Going to run 1 instances... {{(pid=126938) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:04:49.438232 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:04:49.482716 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-54087dca-9263-4ce3-9aca-c41c84d58b4c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489571 Oct 04 09:04:49.483411 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 590/1161] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 09:04:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:04:49.494303 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-ba983ad4-d9f8-4296-b0b7-23ac18a9072c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:49.494915 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-ba983ad4-d9f8-4296-b0b7-23ac18a9072c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:49.551062 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-ba983ad4-d9f8-4296-b0b7-23ac18a9072c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:49.557933 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-ba983ad4-d9f8-4296-b0b7-23ac18a9072c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1218 microversion: 2.1 time: 0.067381 Oct 04 09:04:49.558570 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 572/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:49 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:50.582254 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:50.582977 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:50.589838 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:50.590322 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:50.590760 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:50.591461 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:50.591915 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:50.592563 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:50.671427 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:50.680746 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-02cf64d9-a29c-4808-9059-ce9d68838e2b tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1288 microversion: 2.1 time: 0.102316 Oct 04 09:04:50.681417 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 591/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:50 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:51.704922 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:51.705536 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:51.707987 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=46 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:51.714133 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:51.714632 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:51.715044 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:51.715731 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:51.716176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:51.716590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:51.847035 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:51.855600 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-813cc959-df4d-458f-a520-23e3c4f175cc tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1318 microversion: 2.1 time: 0.154600 Oct 04 09:04:51.856162 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 573/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:51 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:51.863246 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-98ffbf3d-5de0-48c5-b13e-77b1ae69e8c6 req-5fb083a1-8627-4758-b46b-5d6a6f95a2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c35965b-bb57-42a9-9f26-3d65268e9912", "tag": "9068d458-b4b4-4deb-8c84-6ad26e512fe4"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:51.881161 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-98ffbf3d-5de0-48c5-b13e-77b1ae69e8c6 req-5fb083a1-8627-4758-b46b-5d6a6f95a2a4 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:51.881824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-98ffbf3d-5de0-48c5-b13e-77b1ae69e8c6 req-5fb083a1-8627-4758-b46b-5d6a6f95a2a4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:51.882388 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-98ffbf3d-5de0-48c5-b13e-77b1ae69e8c6 req-5fb083a1-8627-4758-b46b-5d6a6f95a2a4 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:51.893613 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-98ffbf3d-5de0-48c5-b13e-77b1ae69e8c6 req-5fb083a1-8627-4758-b46b-5d6a6f95a2a4 service nova] Creating event network-changed:9068d458-b4b4-4deb-8c84-6ad26e512fe4 for instance 0c35965b-bb57-42a9-9f26-3d65268e9912 on hv-cinder-86021 Oct 04 09:04:51.898526 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-98ffbf3d-5de0-48c5-b13e-77b1ae69e8c6 req-5fb083a1-8627-4758-b46b-5d6a6f95a2a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045421 Oct 04 09:04:51.899121 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 592/1165] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:52.879507 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:52.880105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:52.887000 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:52.887420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:52.887845 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:52.888521 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:52.888966 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:52.889385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:53.017046 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:53.024627 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-b24fa6ee-7c0d-4522-a606-79306bfb4fa0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1318 microversion: 2.1 time: 0.149049 Oct 04 09:04:53.025183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 574/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:52 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:54.047993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:54.048692 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:54.054792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:54.055265 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:54.055696 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:54.056374 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:54.056818 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:54.057235 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:54.257506 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:54.265266 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-59eb09dd-3517-4143-8db4-907ef1707a9e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1318 microversion: 2.1 time: 0.221882 Oct 04 09:04:54.265869 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 593/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:54 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:55.289424 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:55.290070 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:55.296385 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:55.296859 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:55.297289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:55.297995 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:55.298444 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:55.298894 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:55.431273 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:55.438928 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-16e956e6-814c-438b-88d3-556c727d09ae tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1318 microversion: 2.1 time: 0.153899 Oct 04 09:04:55.439493 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 575/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:55 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:56.462419 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:56.463030 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:56.465387 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:56.471288 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:56.471768 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:56.472196 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:56.472877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:56.473323 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:56.473764 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:56.477272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:56.603038 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:56.610624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c334a0f8-cfa9-4789-a8d9-1a147e57ee39 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1318 microversion: 2.1 time: 0.152547 Oct 04 09:04:56.611182 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 594/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:56 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:57.506337 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-c11814c4-a68c-4d8a-8577-df9cb9f0eb12 req-5eb05db5-a087-45a6-9dd1-ae48830258f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c35965b-bb57-42a9-9f26-3d65268e9912", "name": "network-vif-plugged", "status": "completed", "tag": "9068d458-b4b4-4deb-8c84-6ad26e512fe4"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:57.512182 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=33 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:57.518696 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c11814c4-a68c-4d8a-8577-df9cb9f0eb12 req-5eb05db5-a087-45a6-9dd1-ae48830258f6 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:57.519187 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c11814c4-a68c-4d8a-8577-df9cb9f0eb12 req-5eb05db5-a087-45a6-9dd1-ae48830258f6 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:57.519805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-c11814c4-a68c-4d8a-8577-df9cb9f0eb12 req-5eb05db5-a087-45a6-9dd1-ae48830258f6 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:57.531282 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-c11814c4-a68c-4d8a-8577-df9cb9f0eb12 req-5eb05db5-a087-45a6-9dd1-ae48830258f6 service nova] Creating event network-vif-plugged:9068d458-b4b4-4deb-8c84-6ad26e512fe4 for instance 0c35965b-bb57-42a9-9f26-3d65268e9912 on hv-cinder-86021 Oct 04 09:04:57.536172 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-c11814c4-a68c-4d8a-8577-df9cb9f0eb12 req-5eb05db5-a087-45a6-9dd1-ae48830258f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 Oct 04 09:04:57.537026 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 576/1170] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:57.633862 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:57.634416 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:57.641995 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:57.642480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:57.642914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:57.643692 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:57.644245 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:57.644968 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:57.838749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:57.846363 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-339fce64-9233-47e9-8988-1d819e688e76 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1318 microversion: 2.1 time: 0.217206 Oct 04 09:04:57.846929 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 595/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:57 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:58.871165 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:58.871869 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:58.878041 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:58.878523 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:58.878961 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:58.879680 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:58.880135 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:58.880562 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:59.012246 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:59.019867 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-8b44b408-f359-4b4c-8003-4f5ac8059d4d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1318 microversion: 2.1 time: 0.154084 Oct 04 09:04:59.020434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 577/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:58 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:00.043424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:00.044034 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:00.046310 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:00.046961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=6 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:00.052829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:00.053303 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:00.054391 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:00.055070 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:00.055522 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:00.055941 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:00.183724 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:00.191938 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-e346ef25-2cfc-4073-8cb2-4e2e25657cf0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1507 microversion: 2.1 time: 0.152398 Oct 04 09:05:00.192512 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 596/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:00 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:05:20.650003 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57735db4-472b-49e4-9477-8f705cfc1133", "device": "/dev/sdb"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:20.653467 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:20.655668 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:20.656881 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:05:20.657028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: Tue Oct 4 09:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912/os-volume_attachments (ip 10.222.0.26) !!! Oct 04 09:05:20.658032 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:20.658671 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=26 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:20.666822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:20.667929 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:20.668369 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:20.669067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:20.669521 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:20.669965 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:20.923183 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-0e536fc7-9ee3-45a1-bec2-30b75959e317 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "POST /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276955 Oct 04 09:05:20.923805 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 578/1174] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 09:05:20 2022] POST /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:05:47.697854 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:47.698428 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:47.700626 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:05:47.700775 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Tue Oct 4 09:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912/os-volume_attachments/57735db4-472b-49e4-9477-8f705cfc1133 (ip 10.222.0.26) !!! Oct 04 09:05:47.702922 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=5 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:47.703666 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=17 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:47.715991 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:47.716475 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:47.716911 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:47.717673 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:47.718155 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:47.718585 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:47.934466 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lazy-loading 'services' on Instance uuid 0c35965b-bb57-42a9-9f26-3d65268e9912 {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:05:48.004824 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-812d3a3a-ec39-4c43-99b3-56987c0e46f3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912/os-volume_attachments/57735db4-472b-49e4-9477-8f705cfc1133" status: 202 len: 0 microversion: 2.1 time: 0.310779 Oct 04 09:05:48.005391 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 597/1175] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 09:05:47 2022] DELETE /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912/os-volume_attachments/57735db4-472b-49e4-9477-8f705cfc1133 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:05:49.129377 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:49.130160 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:49.134125 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:49.134712 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:49.141864 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:49.142341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:49.142772 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:49.143451 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:49.143941 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:49.144347 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:49.170667 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:05:49.243893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-661314ee-31a3-4d9f-839a-622eb525e863 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 204 len: 0 microversion: 2.1 time: 0.115690 Oct 04 09:05:49.244529 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 579/1176] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 09:05:49 2022] DELETE /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:05:49.253738 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:49.254444 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:49.260515 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:49.260997 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:49.261431 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:49.262150 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:49.262603 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:49.263029 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:49.393418 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:49.400993 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-b7fe32a7-123e-45f2-bb4c-ce5fbe9bcda0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1513 microversion: 2.1 time: 0.152017 Oct 04 09:05:49.402175 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 598/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:49 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:50.424888 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:50.425580 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:50.431935 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:50.432409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:50.433469 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:50.434192 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:50.434635 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:50.435051 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:50.615647 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:50.623759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-9ea665bb-ab0a-4a28-872f-3e1614b437c5 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1513 microversion: 2.1 time: 0.203097 Oct 04 09:05:50.624310 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 580/1178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:50 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:51.616914 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-2d4d5dbb-cc06-4c5e-90d1-34f18bc81e59 req-d523102e-fe32-438b-badc-3244836f488c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c35965b-bb57-42a9-9f26-3d65268e9912", "name": "network-vif-deleted", "tag": "9068d458-b4b4-4deb-8c84-6ad26e512fe4"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:51.628624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-2d4d5dbb-cc06-4c5e-90d1-34f18bc81e59 req-d523102e-fe32-438b-badc-3244836f488c service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:51.629091 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-2d4d5dbb-cc06-4c5e-90d1-34f18bc81e59 req-d523102e-fe32-438b-badc-3244836f488c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:51.629516 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-2d4d5dbb-cc06-4c5e-90d1-34f18bc81e59 req-d523102e-fe32-438b-badc-3244836f488c service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:51.642386 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-2d4d5dbb-cc06-4c5e-90d1-34f18bc81e59 req-d523102e-fe32-438b-badc-3244836f488c service nova] Creating event network-vif-deleted:9068d458-b4b4-4deb-8c84-6ad26e512fe4 for instance 0c35965b-bb57-42a9-9f26-3d65268e9912 on hv-cinder-86021 Oct 04 09:05:51.647483 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:51.648105 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:51.648719 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-2d4d5dbb-cc06-4c5e-90d1-34f18bc81e59 req-d523102e-fe32-438b-badc-3244836f488c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Oct 04 09:05:51.653089 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 599/1179] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:05:51.655401 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:51.656144 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:51.656319 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:51.657023 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:51.657480 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:51.657932 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:51.719783 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:51.727653 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-c990c7f0-d4b2-4e93-8f69-16656c1a2824 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 200 len: 1303 microversion: 2.1 time: 0.083994 Oct 04 09:05:51.728217 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 581/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:51 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:52.752122 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:52.752829 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 0c35965b-bb57-42a9-9f26-3d65268e9912] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:52.759189 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:52.759677 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:52.760117 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:52.760807 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:52.761259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:52.761704 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:52.777180 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] HTTP exception thrown: Instance 0c35965b-bb57-42a9-9f26-3d65268e9912 could not be found. Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Request method failure captured: Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 HTTP/1.1 Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_cvTzyfHNtZqaD11sCKYg50QZ3EjrYLmXoxg8YXfyOGOb3Ef8tg2_XiVkE1gfU80PWj6zKctOaAR_WRw-slZ5AWE8wQKAAtFcLr6mytFdjn3I1NJ-rKaYcyy_ZVWvKjVpXYlxEXWBzlqlVsB5YJch-GzlYx7ibSY9iNpg6D3AaxSSQ Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 2e1fb35e7be541c8bec40499ed3ac2d2 Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesSnapshotTestJSON-68141002 Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 09:05:52.778799 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e1fb35e7be541c8bec40499ed3ac2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e1fb35e7be541c8bec40499ed3ac2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e1fb35e7be541c8bec40499ed3ac2d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e1fb35e7be541c8bec40499ed3ac2d2"}]}] Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesSnapshotTestJSON-68141002 Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 2e1fb35e7be541c8bec40499ed3ac2d2 Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-68141002 Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesSnapshotTestJSON-68141002-project Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: e76f24263ef74c28b99e1f882071bf5b Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesSnapshotTestJSON-68141002-project Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 0c35965b-bb57-42a9-9f26-3d65268e9912 could not be found. Oct 04 09:05:52.780749 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '0c35965b-bb57-42a9-9f26-3d65268e9912'} Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c35965b-bb57-42a9-9f26-3d65268e9912 could not be found. Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:05:52.781877 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c35965b-bb57-42a9-9f26-3d65268e9912 could not be found. Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c35965b-bb57-42a9-9f26-3d65268e9912 could not be found. Oct 04 09:05:52.783612 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:05:52.785128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Returning 404 to user: Instance 0c35965b-bb57-42a9-9f26-3d65268e9912 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:05:52.785128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-c8a32d89-eef3-4c61-aeac-78907d8ee0b0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912" status: 404 len: 111 microversion: 2.1 time: 0.032791 Oct 04 09:05:52.785128 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 600/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:52 2022] GET /compute/v2.1/servers/0c35965b-bb57-42a9-9f26-3d65268e9912 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:06:02.615547 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1869436149", "imageRef": "b9e0a485-df02-4e84-83a4-4b6a3b151dff", "flavorRef": "452", "networks": [{"uuid": "33bebe93-2ca6-4734-8581-6b97a9b17f07"}]}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:02.625066 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:02.625739 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:02.671947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.network.neutron [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] validate_networks() for [('33bebe93-2ca6-4734-8581-6b97a9b17f07', None, None, None, None, None)] {{(pid=126939) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:06:03.063994 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Flavor limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:06:03.064414 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Image limits 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:06:03.064886 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Flavor pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:06:03.065292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Image pref 0:0:0 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:06:03.065717 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.virt.hardware [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:06:03.074343 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:03.074821 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:03.075253 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:03.075973 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:03.076430 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:03.076850 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:03.093563 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Getting quotas for project 2e1fb35e7be541c8bec40499ed3ac2d2. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:06:03.097412 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.quota [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Getting quotas for user e76f24263ef74c28b99e1f882071bf5b and project 2e1fb35e7be541c8bec40499ed3ac2d2. Resources: {'instances', 'cores', 'ram'} {{(pid=126939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:06:03.108698 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Going to run 1 instances... {{(pid=126939) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:06:03.111022 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9e0a485-df02-4e84-83a4-4b6a3b151dff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:06:03.156549 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-78054927-8545-44de-9a97-179c0c2ec8d0 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544791 Oct 04 09:06:03.157182 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 582/1182] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 09:06:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:06:03.168581 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0ccad1e4-41b4-43f1-b08a-da146e9a5078 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:03.169198 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0ccad1e4-41b4-43f1-b08a-da146e9a5078 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:03.171732 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=8 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:03.172382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:03.226997 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0ccad1e4-41b4-43f1-b08a-da146e9a5078 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:03.234587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0ccad1e4-41b4-43f1-b08a-da146e9a5078 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1219 microversion: 2.1 time: 0.070312 Oct 04 09:06:03.235259 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 601/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:03 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:04.257808 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:04.258420 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:04.266085 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:04.266608 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:04.267045 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:04.267747 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:04.268194 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:04.268611 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:04.331698 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:04.339759 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-61734858-0e63-4b6f-bef8-f589470c5f48 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1289 microversion: 2.1 time: 0.086281 Oct 04 09:06:04.340322 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 583/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:04 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:05.362902 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:05.363541 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:05.370888 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:05.371382 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:05.371815 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:05.372510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:05.372961 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:05.373384 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:05.582798 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:05.591779 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3db57b28-689a-4813-a99f-f3e782926c3c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.232571 Oct 04 09:06:05.592573 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 602/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:05 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:06:05.614259 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [req-8ff53207-22b0-47c1-9f1f-38e0a5d80ab6 req-e3953fbe-7e00-4dae-95bd-46cbfe5ae9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fab20a0-2da7-4e9c-acf9-1ce4772aee16", "tag": "06b5c956-a237-4b3b-a93d-e3f5f74077ff"}]} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:05.625332 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-8ff53207-22b0-47c1-9f1f-38e0a5d80ab6 req-e3953fbe-7e00-4dae-95bd-46cbfe5ae9d9 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:05.625944 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-8ff53207-22b0-47c1-9f1f-38e0a5d80ab6 req-e3953fbe-7e00-4dae-95bd-46cbfe5ae9d9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:05.626434 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [req-8ff53207-22b0-47c1-9f1f-38e0a5d80ab6 req-e3953fbe-7e00-4dae-95bd-46cbfe5ae9d9 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:05.638315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.compute.server_external_events [req-8ff53207-22b0-47c1-9f1f-38e0a5d80ab6 req-e3953fbe-7e00-4dae-95bd-46cbfe5ae9d9 service nova] Creating event network-changed:06b5c956-a237-4b3b-a93d-e3f5f74077ff for instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 on hv-cinder-86021 Oct 04 09:06:05.643429 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [req-8ff53207-22b0-47c1-9f1f-38e0a5d80ab6 req-e3953fbe-7e00-4dae-95bd-46cbfe5ae9d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032759 Oct 04 09:06:05.644028 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 584/1186] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:06.616012 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:06.616634 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:06.623100 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:06.623587 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:06.624024 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:06.624715 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:06.625172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:06.625601 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:06.752916 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:06.760560 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-cb5d56a2-d700-448d-9afe-e86c296849ee tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.148530 Oct 04 09:06:06.761126 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 603/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:06 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:07.784337 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:07.785034 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:07.791354 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:07.791826 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:07.792305 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:07.793513 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:07.794071 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:07.794492 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:07.927209 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:07.935372 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-273352b8-6dd8-413f-b8c9-6f4367267051 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.155689 Oct 04 09:06:07.935940 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 585/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:07 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:08.958090 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:08.958688 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:08.965842 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:08.966320 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:08.966747 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:08.967421 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:08.967872 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:08.968289 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:09.092963 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:09.100507 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-3f71161f-63d0-44b2-b932-9ef72c772120 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.146330 Oct 04 09:06:09.101065 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 604/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:08 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:10.121901 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:10.122509 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:10.128822 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:10.129292 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:10.129736 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:10.130435 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:10.130884 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:10.131296 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:10.257617 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:10.265110 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-111b1f41-7975-4bbf-820b-b4dcb193272c tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.147076 Oct 04 09:06:10.265675 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 586/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:10 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:06:11.288172 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:11.288848 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:11.295880 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:11.296362 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:11.296792 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:11.297482 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:11.297959 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:11.298376 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:11.425438 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:11.434156 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-6b3d7c14-2b33-4ecf-8263-53fac2c20a71 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.149727 Oct 04 09:06:11.434713 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 605/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:11 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:12.456367 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:12.456968 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:12.463289 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:12.463770 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:12.464236 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:12.465425 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:12.465916 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:12.466341 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:12.598112 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:12.606782 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d1376079-c56c-4111-b030-c2a7dfbd3551 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.154278 Oct 04 09:06:12.607445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 587/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:12 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:12.702272 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-258f12ea-c626-4897-90c3-5fc08e5717b9 req-e4c10285-7f4a-4f4f-b64f-6e041fc2e4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fab20a0-2da7-4e9c-acf9-1ce4772aee16", "name": "network-vif-plugged", "status": "completed", "tag": "06b5c956-a237-4b3b-a93d-e3f5f74077ff"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:12.713480 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-258f12ea-c626-4897-90c3-5fc08e5717b9 req-e4c10285-7f4a-4f4f-b64f-6e041fc2e4c8 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:12.715422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-258f12ea-c626-4897-90c3-5fc08e5717b9 req-e4c10285-7f4a-4f4f-b64f-6e041fc2e4c8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:12.715422 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-258f12ea-c626-4897-90c3-5fc08e5717b9 req-e4c10285-7f4a-4f4f-b64f-6e041fc2e4c8 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:12.726001 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-258f12ea-c626-4897-90c3-5fc08e5717b9 req-e4c10285-7f4a-4f4f-b64f-6e041fc2e4c8 service nova] Creating event network-vif-plugged:06b5c956-a237-4b3b-a93d-e3f5f74077ff for instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 on hv-cinder-86021 Oct 04 09:06:12.730986 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-258f12ea-c626-4897-90c3-5fc08e5717b9 req-e4c10285-7f4a-4f4f-b64f-6e041fc2e4c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033044 Oct 04 09:06:12.731575 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 606/1193] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:13.629710 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:13.630285 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:13.632159 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=2 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:13.632812 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell0:SELECT=6 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:13.639701 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:13.640175 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:13.640605 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:13.641284 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:13.641755 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:13.642175 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:13.768883 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:13.776470 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3aeac833-d911-4416-8a1d-e7c83a6f5005 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1319 microversion: 2.1 time: 0.150744 Oct 04 09:06:13.777522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 588/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:13 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:14.800096 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:14.800834 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:14.802819 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell0:SELECT=2 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:14.809656 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:14.810166 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:14.810623 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:14.811299 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:14.811757 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:14.812188 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:14.942115 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:14.950023 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-0648a636-7cdc-44ef-9a46-5ed9f95ee1d3 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1508 microversion: 2.1 time: 0.154265 Oct 04 09:06:14.950588 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 607/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:14 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:14.972371 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6b72f49-2b90-4aac-956f-79b2e39b5e38", "device": "/dev/sdb"}} {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:14.974784 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:14.981540 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:14.982067 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:14.982495 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:14.983168 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:14.983612 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:14.984029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:15.231514 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-d93d7bed-8d9b-4e28-9c06-09f4bf8802bf tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "POST /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262692 Oct 04 09:06:15.232140 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 589/1196] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 09:06:14 2022] POST /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:36.647481 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:36.647982 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:36.650367 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_api:SELECT=16 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:36.651093 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG dbcounter [-] [126938] Writing DB stats nova_cell1:SELECT=32 {{(pid=126938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:36.657618 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:36.659268 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:36.659268 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:36.659852 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:36.660298 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:36.660723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:36.742184 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.objects.instance [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lazy-loading 'services' on Instance uuid 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 {{(pid=126938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:06:36.811631 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-89989b0d-22e8-4618-99c7-51ae7a42086e tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16/os-volume_attachments/e6b72f49-2b90-4aac-956f-79b2e39b5e38" status: 202 len: 0 microversion: 2.1 time: 0.167777 Oct 04 09:06:36.812297 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 608/1197] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 09:06:36 2022] DELETE /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16/os-volume_attachments/e6b72f49-2b90-4aac-956f-79b2e39b5e38 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:06:37.934678 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:37.935315 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:37.937893 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:37.938576 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG dbcounter [-] [126939] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:37.945084 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:37.945590 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:37.946050 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:37.946730 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:37.947176 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:37.947593 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:37.974866 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Going to try to terminate instance {{(pid=126939) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:06:38.048073 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-27efc5ec-383f-4c1f-afa0-7cf510d906ed tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 204 len: 0 microversion: 2.1 time: 0.117332 Oct 04 09:06:38.048854 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 590/1198] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 09:06:37 2022] DELETE /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:06:38.057723 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:38.059424 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:38.066031 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:38.066510 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:38.066939 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:38.067630 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:38.068077 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:38.068500 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:38.196491 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.policy [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126938) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:38.204619 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-2d70f194-527e-4bad-a92c-cae44162dc8d tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1514 microversion: 2.1 time: 0.151279 Oct 04 09:06:38.205173 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 609/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:38 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:39.228742 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:39.229445 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:39.236447 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:39.236930 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:39.237363 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:39.238069 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:39.238522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:39.238947 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:39.366541 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:39.374354 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-3519f805-4847-48fa-acc1-39b6da49f0d8 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1514 microversion: 2.1 time: 0.149826 Oct 04 09:06:39.374921 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 591/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:39 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:40.374163 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [req-b195cddd-f92d-4f61-aa11-41b2209ccb81 req-53bb08c9-1265-4f32-84e5-64fbf411c508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fab20a0-2da7-4e9c-acf9-1ce4772aee16", "name": "network-vif-deleted", "tag": "06b5c956-a237-4b3b-a93d-e3f5f74077ff"}]} {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:40.384103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-b195cddd-f92d-4f61-aa11-41b2209ccb81 req-53bb08c9-1265-4f32-84e5-64fbf411c508 service nova] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:40.384661 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-b195cddd-f92d-4f61-aa11-41b2209ccb81 req-53bb08c9-1265-4f32-84e5-64fbf411c508 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:40.385098 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [req-b195cddd-f92d-4f61-aa11-41b2209ccb81 req-53bb08c9-1265-4f32-84e5-64fbf411c508 service nova] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:40.396258 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.compute.server_external_events [req-b195cddd-f92d-4f61-aa11-41b2209ccb81 req-53bb08c9-1265-4f32-84e5-64fbf411c508 service nova] Creating event network-vif-deleted:06b5c956-a237-4b3b-a93d-e3f5f74077ff for instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 on hv-cinder-86021 Oct 04 09:06:40.396584 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.api.openstack.wsgi [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:40.397379 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.compute.api [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126939) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:40.401907 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [req-b195cddd-f92d-4f61-aa11-41b2209ccb81 req-53bb08c9-1265-4f32-84e5-64fbf411c508 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032025 Oct 04 09:06:40.402708 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 610/1201] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:40.403614 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:40.404522 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:40.404740 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:40.405500 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:40.406029 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:40.406450 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG oslo_concurrency.lockutils [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:40.471497 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: DEBUG nova.policy [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76f24263ef74c28b99e1f882071bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1fb35e7be541c8bec40499ed3ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126939) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:40.479409 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: INFO nova.api.openstack.requestlog [None req-46c70115-e58e-4e5e-83a2-42258c7e2d53 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 200 len: 1304 microversion: 2.1 time: 0.087005 Oct 04 09:06:40.480505 dv-cinder-860212-1-iscsi devstack@n-api.service[126939]: [pid: 126939|app: 0|req: 592/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:40 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:06:41.503624 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Calling method '>' {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:41.504328 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.compute.api [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] [instance: 3fab20a0-2da7-4e9c-acf9-1ce4772aee16] Fetching instance by UUID {{(pid=126938) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:41.510521 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:41.511002 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:41.511436 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:41.512123 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Acquiring lock "2cae228f-af20-4704-b46a-066502ec8d5b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:41.512567 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:41.512996 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG oslo_concurrency.lockutils [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Lock "2cae228f-af20-4704-b46a-066502ec8d5b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:41.526006 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.wsgi [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] HTTP exception thrown: Instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 could not be found. Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Request method failure captured: Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: request: GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 HTTP/1.1 Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept: application/json Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Accept-Encoding: identity Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Connection: close Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Length: 0 Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Content-Type: application/json Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Host: 10.222.0.26 Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: Openstack-System-Scope: None Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: User-Agent: python-urllib3/1.26.12 Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Auth-Token: gAAAAABjO_cvTzyfHNtZqaD11sCKYg50QZ3EjrYLmXoxg8YXfyOGOb3Ef8tg2_XiVkE1gfU80PWj6zKctOaAR_WRw-slZ5AWE8wQKAAtFcLr6mytFdjn3I1NJ-rKaYcyy_ZVWvKjVpXYlxEXWBzlqlVsB5YJch-GzlYx7ibSY9iNpg6D3AaxSSQ Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Id: None Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Domain-Name: None Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Identity-Status: Confirmed Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Is-Admin-Project: True Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Id: default Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Domain-Name: Default Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Id: 2e1fb35e7be541c8bec40499ed3ac2d2 Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Project-Name: tempest-VolumesSnapshotTestJSON-68141002 Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Role: reader,member Oct 04 09:06:41.528073 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Roles: reader,member Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e1fb35e7be541c8bec40499ed3ac2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e1fb35e7be541c8bec40499ed3ac2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e1fb35e7be541c8bec40499ed3ac2d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e1fb35e7be541c8bec40499ed3ac2d2"}]}] Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant: tempest-VolumesSnapshotTestJSON-68141002 Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Id: 2e1fb35e7be541c8bec40499ed3ac2d2 Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-68141002 Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User: tempest-VolumesSnapshotTestJSON-68141002-project Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Id: default Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Domain-Name: Default Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Id: e76f24263ef74c28b99e1f882071bf5b Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: X-User-Name: tempest-VolumesSnapshotTestJSON-68141002-project Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: method: > Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: exception: Instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 could not be found. Oct 04 09:06:41.529975 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: action_args: {'id': '3fab20a0-2da7-4e9c-acf9-1ce4772aee16'} Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: {{(pid=126938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 could not be found. Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:06:41.531103 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 could not be found. Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 could not be found. Oct 04 09:06:41.532936 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: ERROR nova.api.openstack.wsgi Oct 04 09:06:41.534525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: DEBUG nova.api.openstack.wsgi [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] Returning 404 to user: Instance 3fab20a0-2da7-4e9c-acf9-1ce4772aee16 could not be found. {{(pid=126938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:06:41.534525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: INFO nova.api.openstack.requestlog [None req-57e0a3e4-4914-4802-ae6b-c49252a34b79 tempest-VolumesSnapshotTestJSON-68141002 tempest-VolumesSnapshotTestJSON-68141002-project] 10.222.0.26 "GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16" status: 404 len: 111 microversion: 2.1 time: 0.030552 Oct 04 09:06:41.534525 dv-cinder-860212-1-iscsi devstack@n-api.service[126938]: [pid: 126938|app: 0|req: 611/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:41 2022] GET /compute/v2.1/servers/3fab20a0-2da7-4e9c-acf9-1ce4772aee16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)